Apr 13 21:38:44 user devstack@n-api.service[61662]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 13 21:38:44 user devstack@n-api.service[61662]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 13 21:38:44 2023] *** Apr 13 21:38:44 user devstack@n-api.service[61662]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 13 21:38:44 user devstack@n-api.service[61662]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 13 21:38:44 user devstack@n-api.service[61662]: nodename: user Apr 13 21:38:44 user devstack@n-api.service[61662]: machine: x86_64 Apr 13 21:38:44 user devstack@n-api.service[61662]: clock source: unix Apr 13 21:38:44 user devstack@n-api.service[61662]: pcre jit disabled Apr 13 21:38:44 user devstack@n-api.service[61662]: detected number of CPU cores: 12 Apr 13 21:38:44 user devstack@n-api.service[61662]: current working directory: / Apr 13 21:38:44 user devstack@n-api.service[61662]: detected binary path: /usr/bin/uwsgi-core Apr 13 21:38:44 user devstack@n-api.service[61662]: your processes number limit is 63637 Apr 13 21:38:44 user devstack@n-api.service[61662]: your memory page size is 4096 bytes Apr 13 21:38:44 user devstack@n-api.service[61662]: detected max file descriptor number: 2048 Apr 13 21:38:44 user devstack@n-api.service[61662]: lock engine: pthread robust mutexes Apr 13 21:38:44 user devstack@n-api.service[61662]: thunder lock: enabled Apr 13 21:38:44 user devstack@n-api.service[61662]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 13 21:38:44 user devstack@n-api.service[61662]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 13 21:38:44 user devstack@n-api.service[61662]: Python main interpreter initialized at 0x55a0b3984990 Apr 13 21:38:44 user devstack@n-api.service[61662]: python threads support enabled Apr 13 21:38:44 user devstack@n-api.service[61662]: your server socket listen backlog is limited to 100 connections Apr 13 21:38:44 user devstack@n-api.service[61662]: your mercy for graceful operations on workers is 90 seconds Apr 13 21:38:44 user devstack@n-api.service[61662]: mapped 537436 bytes (524 KB) for 3 cores Apr 13 21:38:44 user devstack@n-api.service[61662]: *** Operational MODE: preforking *** Apr 13 21:38:44 user devstack@n-api.service[61662]: *** uWSGI is running in multiple interpreter mode *** Apr 13 21:38:44 user devstack@n-api.service[61662]: spawned uWSGI master process (pid: 61662) Apr 13 21:38:44 user devstack@n-api.service[61662]: spawned uWSGI worker 1 (pid: 61663, cores: 1) Apr 13 21:38:44 user devstack@n-api.service[61662]: spawned uWSGI worker 2 (pid: 61664, cores: 1) Apr 13 21:38:44 user devstack@n-api.service[61662]: spawned uWSGI worker 3 (pid: 61665, cores: 1) Apr 13 21:38:44 user devstack@n-api.service[61662]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 13 21:38:45 user devstack@n-api.service[61663]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 21:38:45 user devstack@n-api.service[61664]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 21:38:45 user devstack@n-api.service[61665]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 21:38:48 user devstack@n-api.service[61665]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 21:38:48 user devstack@n-api.service[61665]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 21:38:48 user devstack@n-api.service[61665]: and ``live_migration_inbound_addr`` respectively. Apr 13 21:38:48 user devstack@n-api.service[61665]: ). Its value may be silently ignored in the future. Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61665) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 21:38:48 user devstack@n-api.service[61663]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 21:38:48 user devstack@n-api.service[61663]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 21:38:48 user devstack@n-api.service[61663]: and ``live_migration_inbound_addr`` respectively. Apr 13 21:38:48 user devstack@n-api.service[61663]: ). Its value may be silently ignored in the future. Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 13 21:38:48 user devstack@n-api.service[61664]: live_migration_uri is deprecated for removal in favor of two other options that Apr 13 21:38:48 user devstack@n-api.service[61664]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 13 21:38:48 user devstack@n-api.service[61664]: and ``live_migration_inbound_addr`` respectively. Apr 13 21:38:48 user devstack@n-api.service[61664]: ). Its value may be silently ignored in the future. Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: INFO dbcounter [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Registered counter for database nova_api Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_db.sqlalchemy.engines [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61665) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writer thread running {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61663) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61664) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG nova.context [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02a5ac41-3f13-423f-89bb-da05d1dcefff(cell1) {{(pid=61665) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:48 user devstack@n-api.service[61665]: INFO dbcounter [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Registered counter for database nova_cell0 Apr 13 21:38:48 user devstack@n-api.service[61665]: INFO dbcounter [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Registered counter for database nova_cell1 Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_db.sqlalchemy.engines [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61665) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG oslo_db.sqlalchemy.engines [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61665) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writer thread running {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:48 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writer thread running {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:48 user devstack@n-api.service[61663]: INFO dbcounter [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Registered counter for database nova_api Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:48 user devstack@n-api.service[61664]: INFO dbcounter [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Registered counter for database nova_api Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:48 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG nova.context [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02a5ac41-3f13-423f-89bb-da05d1dcefff(cell1) {{(pid=61663) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:48 user devstack@n-api.service[61663]: INFO dbcounter [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Registered counter for database nova_cell0 Apr 13 21:38:49 user devstack@n-api.service[61663]: INFO dbcounter [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Registered counter for database nova_cell1 Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61665]: INFO dbcounter [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Registered counter for database nova_cell0 Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG nova.context [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),02a5ac41-3f13-423f-89bb-da05d1dcefff(cell1) {{(pid=61664) load_cells /opt/stack/nova/nova/context.py:464}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:49 user devstack@n-api.service[61665]: DEBUG oslo_db.sqlalchemy.engines [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61665) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:38:49 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writer thread running {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61664]: INFO dbcounter [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Registered counter for database nova_cell0 Apr 13 21:38:49 user devstack@n-api.service[61664]: INFO dbcounter [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Registered counter for database nova_cell1 Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61663]: INFO dbcounter [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Registered counter for database nova_cell0 Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61663) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writer thread running {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61664]: INFO dbcounter [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Registered counter for database nova_cell0 Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61664) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 13 21:38:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writer thread running {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 13 21:38:49 user devstack@n-api.service[61665]: WARNING keystonemiddleware.auth_token [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61665]: WARNING keystonemiddleware.auth_token [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61665]: WARNING keystonemiddleware.auth_token [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61665]: WARNING keystonemiddleware.auth_token [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61665]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a0b3984990 pid: 61665 (default app) Apr 13 21:38:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:38:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001481 Apr 13 21:38:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 13 21:38:49 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:38:49 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61663]: WARNING keystonemiddleware.auth_token [None req-6fb71e17-95f5-4abd-ba47-abd1b62fda16 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61663]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a0b3984990 pid: 61663 (default app) Apr 13 21:38:49 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 13 21:38:49 user devstack@n-api.service[61664]: WARNING keystonemiddleware.auth_token [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 13 21:38:49 user devstack@n-api.service[61664]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a0b3984990 pid: 61664 (default app) Apr 13 21:40:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:40:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-778ed62d-2235-4ce3-a955-9e13c43a7783 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001518 Apr 13 21:40:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:40:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:40:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5266db4a-f09b-4c5f-b48d-927415bfd6ba admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:40:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5266db4a-f09b-4c5f-b48d-927415bfd6ba admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.384912 Apr 13 21:40:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 21:40:57 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:40:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:40:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002772 Apr 13 21:40:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:40:59 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:40:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:40:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:00 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bcdd9970-56b0-41ad-be82-5dba1bb2b996 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bcdd9970-56b0-41ad-be82-5dba1bb2b996 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450835 Apr 13 21:41:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:40:59 2023] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-826f44e6-6e75-4a16-944a-4c82f0653ab4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-826f44e6-6e75-4a16-944a-4c82f0653ab4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048707 Apr 13 21:41:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 21:41:00 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001292 Apr 13 21:41:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-98dc2641-128f-4cbe-980e-ccfc39c77525 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-98dc2641-128f-4cbe-980e-ccfc39c77525 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063670 Apr 13 21:41:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:02 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0c73fe3d-2920-418c-937f-8c053bb76246 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0c73fe3d-2920-418c-937f-8c053bb76246 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032682 Apr 13 21:41:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 21:41:02 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002057 Apr 13 21:41:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:04 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-fe70f877-fe54-49f8-b291-2430579269b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-fe70f877-fe54-49f8-b291-2430579269b0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059879 Apr 13 21:41:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:04 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-449093b3-421f-4c65-b679-9cc9f51ab08f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-449093b3-421f-4c65-b679-9cc9f51ab08f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025180 Apr 13 21:41:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 21:41:04 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001538 Apr 13 21:41:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c172356b-7d04-4c2c-8446-deb791157a95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "disk": 10}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c172356b-7d04-4c2c-8446-deb791157a95 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060354 Apr 13 21:41:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:06 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-09a01615-fb3a-4ea7-94cb-6cd19b8ae822 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-09a01615-fb3a-4ea7-94cb-6cd19b8ae822 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025058 Apr 13 21:41:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 21:41:06 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001445 Apr 13 21:41:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-54d169ea-b605-4543-82e5-56b3d8c4418f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-54d169ea-b605-4543-82e5-56b3d8c4418f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.056433 Apr 13 21:41:08 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:08 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023296 Apr 13 21:41:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 13 21:41:08 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4fb92fda-d2cf-4a81-9e3d-cbf84129ce47 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001962 Apr 13 21:41:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2b53e075-3722-4cef-a710-054b234d0423 admin admin] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-2b53e075-3722-4cef-a710-054b234d0423 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070712 Apr 13 21:41:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 13 21:41:10 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 21:41:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001673 Apr 13 21:41:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:12 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f9b347b8-e5ea-4894-8c9d-d1450bf5dc72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "id": "1", "vcpus": 1}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f9b347b8-e5ea-4894-8c9d-d1450bf5dc72 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.376529 Apr 13 21:41:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:12 2023] POST /compute/v2.1/flavors => generated 400 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 13 21:41:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-31d55d71-1bb5-4a95-95aa-7cedb91f5b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-31d55d71-1bb5-4a95-95aa-7cedb91f5b66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041198 Apr 13 21:41:12 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 21:41:12 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001353 Apr 13 21:41:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e7b45709-b4e7-438d-a649-93e3d95eb86b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "name": "m1.small"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e7b45709-b4e7-438d-a649-93e3d95eb86b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.098200 Apr 13 21:41:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:14 2023] POST /compute/v2.1/flavors => generated 403 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-aa501979-0e43-4716-9955-f8b0b5daf174 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-aa501979-0e43-4716-9955-f8b0b5daf174 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029558 Apr 13 21:41:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 21:41:14 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001379 Apr 13 21:41:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-658abfe9-b695-4e5b-89ca-1e37ea6752e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-658abfe9-b695-4e5b-89ca-1e37ea6752e6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061091 Apr 13 21:41:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:16 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-618dbdde-7fb8-49af-ab21-d3ef94734958 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-618dbdde-7fb8-49af-ab21-d3ef94734958 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039846 Apr 13 21:41:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 21:41:17 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001737 Apr 13 21:41:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-89b9ab46-b78e-4873-b8af-82b01b768e07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-89b9ab46-b78e-4873-b8af-82b01b768e07 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057725 Apr 13 21:41:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:18 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4ebcd6c0-02cd-4f5c-ad24-d7665db0f4b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4ebcd6c0-02cd-4f5c-ad24-d7665db0f4b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024801 Apr 13 21:41:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 21:41:19 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001369 Apr 13 21:41:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 13 21:41:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c52d51b-d42f-4a13-a416-999b38eac01b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2c52d51b-d42f-4a13-a416-999b38eac01b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.056998 Apr 13 21:41:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 13 21:41:21 2023] POST /compute/v2.1/flavors => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:41:21 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-21e6f748-75e2-4659-aa9a-533e5a14c29c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:41:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-21e6f748-75e2-4659-aa9a-533e5a14c29c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025454 Apr 13 21:41:21 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 13 21:41:21 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:41:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9bce00fe-e03a-449b-b813-f9775f188744 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001717 Apr 13 21:41:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 21:41:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:41:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:41:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.096711 Apr 13 21:41:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 13 21:41:52 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:42:24 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-21e6f748-75e2-4659-aa9a-533e5a14c29c admin admin] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:42:24 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-21e6f748-75e2-4659-aa9a-533e5a14c29c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001465 Apr 13 21:42:24 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 21:42:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:42:24 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:42:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5ce15cb5-5d81-4cb5-ae58-fdf7ad1b09c1 admin admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:42:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5ce15cb5-5d81-4cb5-ae58-fdf7ad1b09c1 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.063901 Apr 13 21:42:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 13 21:42:24 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:42:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:42:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002795 Apr 13 21:42:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 21:42:29 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:42:29 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:42:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ec02160e-fe9f-405a-ad1f-007ae069a704 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "42", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 128, "name": "m1.nano", "disk": 1}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:42:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ec02160e-fe9f-405a-ad1f-007ae069a704 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061951 Apr 13 21:42:29 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 21:42:29 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:42:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5ca2b88d-7c7e-48f9-aea1-e5fab60e1082 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:42:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5ca2b88d-7c7e-48f9-aea1-e5fab60e1082 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028077 Apr 13 21:42:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 21:42:29 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:42:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:42:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8a40732a-027a-4b84-b1d2-829fc61fa8c5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001550 Apr 13 21:42:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 13 21:42:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:42:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a837fc3c-9440-4499-adc9-d4eac0c55347 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "ram": 192, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:42:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a837fc3c-9440-4499-adc9-d4eac0c55347 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075545 Apr 13 21:42:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 13 21:42:33 2023] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:42:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-45bc22bb-5fcd-4996-80af-0e5fe30ea3bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:42:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-45bc22bb-5fcd-4996-80af-0e5fe30ea3bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023691 Apr 13 21:42:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 13 21:42:33 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:44:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:44:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:44:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:44:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-18909dc3-840f-419e-bce9-60051b93a6b5 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Action: 'create', calling method: .version_select at 0x7f4b3dbcd870>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-556119524", "metadata": {"Type": "work"}}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:44:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-18909dc3-840f-419e-bce9-60051b93a6b5 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.603164 Apr 13 21:44:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 21:44:47 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1605 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 13 21:44:49 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:44:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-32cc7c53-b83b-4c8f-822e-dc38fd06c1e1 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3da7f520>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-32cc7c53-b83b-4c8f-822e-dc38fd06c1e1 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 352 microversion: 2.1 time: 0.221765 Apr 13 21:44:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:49 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:44:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4f8756c4-b1e1-40c4-b21d-a81f158acc53 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3db4ec20>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4f8756c4-b1e1-40c4-b21d-a81f158acc53 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 353 microversion: 2.1 time: 0.188437 Apr 13 21:44:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:50 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bca751db-3fcf-48da-9b85-9767e3db4f00 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d904f70>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bca751db-3fcf-48da-9b85-9767e3db4f00 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 353 microversion: 2.1 time: 0.049572 Apr 13 21:44:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:50 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9e6499d5-4263-4663-87f6-d621d83dbb13 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d9037f0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9e6499d5-4263-4663-87f6-d621d83dbb13 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 202 len: 0 microversion: 2.1 time: 0.095542 Apr 13 21:44:50 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:44:50 2023] DELETE /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:44:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-610b5cbd-066d-4b32-930b-39ec1e0cfb10 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3dafba30>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-610b5cbd-066d-4b32-930b-39ec1e0cfb10 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 352 microversion: 2.1 time: 0.058904 Apr 13 21:44:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:50 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6806201c-7684-42d2-b39f-76f526581f0d tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d9051b0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6806201c-7684-42d2-b39f-76f526581f0d tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 352 microversion: 2.1 time: 0.063971 Apr 13 21:44:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:51 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 352 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bf6a5208-efd1-4540-8143-6add4b572187 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d903eb0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bf6a5208-efd1-4540-8143-6add4b572187 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 352 microversion: 2.1 time: 0.061049 Apr 13 21:44:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:52 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bbfa56b2-8ace-4b4a-a90d-3e172d832a79 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d914160>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bbfa56b2-8ace-4b4a-a90d-3e172d832a79 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 200 len: 352 microversion: 2.1 time: 0.046913 Apr 13 21:44:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:54 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:44:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d10595e9-a893-457e-af7c-f8d893f45921 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Calling method '.version_select at 0x7f4b3d9056c0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:44:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-d10595e9-a893-457e-af7c-f8d893f45921 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] HTTP exception thrown: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. Apr 13 21:44:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d10595e9-a893-457e-af7c-f8d893f45921 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Request method failure captured: Apr 13 21:44:55 user devstack@n-api.service[61664]: request: GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 HTTP/1.1 Apr 13 21:44:55 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:44:55 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:44:55 user devstack@n-api.service[61664]: Connection: close Apr 13 21:44:55 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:44:55 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:44:55 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:44:55 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:44:55 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfPkwerg4tEa_wWGNABNkUk9WhD9Fta76gpWxWLE1zNJEWYst1r4GnUMLJSr3Vip0hgiyAzegLK21ohBKqTaUCq1tB3AZp-qs4iUvJ3M9DskujMvgQF-Y5H57to9O64JSEVOABA_RttsNxWRxXmzsGnH9ChOkZ5t2t-ctmq2tnZz1s Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Project-Id: c2296cb13981451083371f5c01c2407a Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesGetTestJSON-465180010 Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c2296cb13981451083371f5c01c2407a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2296cb13981451083371f5c01c2407a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2296cb13981451083371f5c01c2407a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesGetTestJSON-465180010 Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Tenant-Id: c2296cb13981451083371f5c01c2407a Apr 13 21:44:55 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesGetTestJSON-465180010 Apr 13 21:44:55 user devstack@n-api.service[61664]: X-User: tempest-VolumesGetTestJSON-465180010-project-member Apr 13 21:44:55 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:44:55 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:44:55 user devstack@n-api.service[61664]: X-User-Id: 25458154bdf24e958da8e54697905829 Apr 13 21:44:55 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesGetTestJSON-465180010-project-member Apr 13 21:44:55 user devstack@n-api.service[61664]: method: Apr 13 21:44:55 user devstack@n-api.service[61664]: exception: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. Apr 13 21:44:55 user devstack@n-api.service[61664]: action_args: {'id': '9782ff83-f891-4bb4-a85d-89ae0704f300'} Apr 13 21:44:55 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. (HTTP 404) (Request-ID: req-b4a33440-b023-4c51-b27c-b3b73016e9a9) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. Apr 13 21:44:55 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:44:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d10595e9-a893-457e-af7c-f8d893f45921 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] Returning 404 to user: Volume 9782ff83-f891-4bb4-a85d-89ae0704f300 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:44:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d10595e9-a893-457e-af7c-f8d893f45921 tempest-VolumesGetTestJSON-465180010 tempest-VolumesGetTestJSON-465180010-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300" status: 404 len: 109 microversion: 2.1 time: 0.044208 Apr 13 21:44:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:44:55 2023] GET /compute/v2.1/os-volumes/9782ff83-f891-4bb4-a85d-89ae0704f300 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:44:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f60c5492-d6e9-4d74-b8b5-c916362c06ec tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d903b50>, body: {"keypair": {"name": "tempest-keypair-789187285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtoB3nR0JKHa6Ky1vXPwyI7w+rB3Ypa07sW6QVuaj3CXiFeuqRSmd55pQSr/lvFo9l5efcEiAn2oFJFeJlQXi0+ollyvkUFol9Z6nrTwTO2rVl/RiddJVHfv6WKf61UrQ=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:44:59 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-f60c5492-d6e9-4d74-b8b5-c916362c06ec tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for project 3605d609b52b431993bcea0798a77554. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:44:59 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-f60c5492-d6e9-4d74-b8b5-c916362c06ec tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for user 60e4dadf9d9e41e6a91ee03a0cd50dc3 and project 3605d609b52b431993bcea0798a77554. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:44:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f60c5492-d6e9-4d74-b8b5-c916362c06ec tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.355216 Apr 13 21:44:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 20/56] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:44:58 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-579437522", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:04 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] validate_networks() for [('0a365911-1489-441d-8c9a-91c593bb18af', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0464b337-a16d-4d43-a193-03c705c3a248 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d9063b0>, body: {"keypair": {"name": "tempest-keypair-1819128718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7Ml5lpGb1VqwPVwkwwsf5pboDo62epDSWqFRNEqAUVYF/2w516xO62Qmmp9j0l22MQEwYg4/k1ON4am0hAmYwpEbqC0e1pEBIaEp/IKSH66LA6p3lpAdZWEotG6J5hwQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:04 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0464b337-a16d-4d43-a193-03c705c3a248 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for project 73c23bc3e8b14441b4622095502b5dae. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:04 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0464b337-a16d-4d43-a193-03c705c3a248 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for user 3f151b673e3d47acb9c3ed9b9ecaf687 and project 73c23bc3e8b14441b4622095502b5dae. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0464b337-a16d-4d43-a193-03c705c3a248 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.140227 Apr 13 21:45:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 19/57] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 21:45:04 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 141 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:45:05 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2106730690", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-140399517", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "05504462-8db4-4453-90fd-55cfd765138e"}], "security_groups": [{"name": "tempest-securitygroup--895708393"}], "key_name": "tempest-keypair-789187285", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:06 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] validate_networks() for [('ed9169cc-af6d-4d31-9b2e-9016c5f963c4', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:06 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] validate_networks() for [('05504462-8db4-4453-90fd-55cfd765138e', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for user e77459bc3fa8496da1a089c460e32ed2 and project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d9f669e6-a3b7-4739-a32e-92cca8497afe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 3.002499 Apr 13 21:45:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:04 2023] POST /compute/v2.1/servers => generated 381 bytes in 3004 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6f38a883-cdf1-4c3e-8114-60582e7f1391 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6f38a883-cdf1-4c3e-8114-60582e7f1391 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting quotas for project f1071d640fb44ff9966fab7888668ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting quotas for user 02a7fc7a42b441cfa3c6bc04f4dd6cb9 and project f1071d640fb44ff9966fab7888668ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-6f38a883-cdf1-4c3e-8114-60582e7f1391 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-49e13637-fea5-42e2-9e92-c17a494a6db8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.598172 Apr 13 21:45:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 21/59] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6f38a883-cdf1-4c3e-8114-60582e7f1391 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1215 microversion: 2.1 time: 0.223288 Apr 13 21:45:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:07 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-95311b7e-415f-4cba-9a07-18b25ac36829 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-95311b7e-415f-4cba-9a07-18b25ac36829 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-402733805", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:07 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-95311b7e-415f-4cba-9a07-18b25ac36829 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-95311b7e-415f-4cba-9a07-18b25ac36829 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1211 microversion: 2.1 time: 0.241061 Apr 13 21:45:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 22/61] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:07 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1211 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:07 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] validate_networks() for [('0a365911-1489-441d-8c9a-91c593bb18af', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for project 3605d609b52b431993bcea0798a77554. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for user 60e4dadf9d9e41e6a91ee03a0cd50dc3 and project 3605d609b52b431993bcea0798a77554. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-22082419-92bc-4cbc-a007-5a6af0af85a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.595685 Apr 13 21:45:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 20/62] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:05 2023] POST /compute/v2.1/servers => generated 399 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-58029613-bda9-4c55-ba8b-166fae8f7bdf tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:08 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-58029613-bda9-4c55-ba8b-166fae8f7bdf tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:08 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-58029613-bda9-4c55-ba8b-166fae8f7bdf tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-58029613-bda9-4c55-ba8b-166fae8f7bdf tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1230 microversion: 2.1 time: 0.156672 Apr 13 21:45:08 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 23/63] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:08 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1230 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for user e77459bc3fa8496da1a089c460e32ed2 and project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-199a3766-e7a8-4f5e-bbf5-b06a338de28d tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.093690 Apr 13 21:45:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:07 2023] POST /compute/v2.1/servers => generated 381 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c90c1bfd-1b7e-4274-a05e-4ebc8ade4800 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c90c1bfd-1b7e-4274-a05e-4ebc8ade4800 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d83fa331-3728-4252-9213-676b2b4f6134 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d829630>, body: {"keypair": {"name": "tempest-keypair-1172830782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEyy8lvN5JxTozYg9ByYCQUUKEcNGunFuCkWcpXFzcQgw9m/DW6nJHXR8e8LkSDM7KZy5/LgblZ7q8T1OTnPbj9wKvTJ0iV6fPco0NWPjXLrW2GtaHDcybWSGRNToUsWA=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:09 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-d83fa331-3728-4252-9213-676b2b4f6134 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting quotas for project d4235a17cc95422dacb6386d4952fc8e. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:09 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-d83fa331-3728-4252-9213-676b2b4f6134 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting quotas for user c3c1bbf573ea436293abf4debdecc515 and project d4235a17cc95422dacb6386d4952fc8e. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d83fa331-3728-4252-9213-676b2b4f6134 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127356 Apr 13 21:45:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 24/65] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:45:09 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c90c1bfd-1b7e-4274-a05e-4ebc8ade4800 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c90c1bfd-1b7e-4274-a05e-4ebc8ade4800 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 200 len: 1215 microversion: 2.1 time: 0.206066 Apr 13 21:45:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 21/66] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:09 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1801509642", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "77c75177-3563-451c-a6d0-02f4c7cd7a7d"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:12 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] validate_networks() for [('77c75177-3563-451c-a6d0-02f4c7cd7a7d', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Getting quotas for project 45aed26c3fb143cab8c3c1599f70d858. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Getting quotas for user 7299dc5fc1ad4f3eb769eda4dac5abe1 and project 45aed26c3fb143cab8c3c1599f70d858. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1025681919", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ae194169-1c43-4713-9bac-e45364ca6179"}], "security_groups": [{"name": "tempest-securitygroup--968177605"}], "key_name": "tempest-keypair-1819128718", "user_data": "}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c49c778e-38f2-41fd-8508-d51706159987 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.613691 Apr 13 21:45:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:12 2023] POST /compute/v2.1/servers => generated 378 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1b144d16-ccd2-4e14-bca7-14d7fc84c132 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1b144d16-ccd2-4e14-bca7-14d7fc84c132 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:14 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1b144d16-ccd2-4e14-bca7-14d7fc84c132 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7299dc5fc1ad4f3eb769eda4dac5abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aed26c3fb143cab8c3c1599f70d858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1b144d16-ccd2-4e14-bca7-14d7fc84c132 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 200 len: 1209 microversion: 2.1 time: 0.174031 Apr 13 21:45:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 22/68] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:14 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 1209 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:14 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] validate_networks() for [('ae194169-1c43-4713-9bac-e45364ca6179', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Creating event network-changed:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-33de1ab0-4a5f-402b-b169-5f0de5745fcf req-3161f0c0-c771-47e4-90ef-57a737012deb service nova] Acquired lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:15 user devstack@n-api.service[61663]: INFO nova.compute.rpcapi [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 21:45:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] Releasing lock "compute-rpcapi-router" {{(pid=61663) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 21:45:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6ebb6c80-1cda-4b6c-b9b6-28328dfeb62e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176508 Apr 13 21:45:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for project 73c23bc3e8b14441b4622095502b5dae. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for user 3f151b673e3d47acb9c3ed9b9ecaf687 and project 73c23bc3e8b14441b4622095502b5dae. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b43249a0-4154-4b98-b5f9-287ef169aed4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.598868 Apr 13 21:45:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 25/70] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:45:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:45:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1586666894", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "7401a99a-44e9-442d-8f64-8591e14e8388"}], "security_groups": [{"name": "tempest-securitygroup--638663080"}], "key_name": "tempest-keypair-1172830782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:16 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:16 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:16 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-95f3c53d-19a4-46df-bd5a-a90417e45a3e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1276 microversion: 2.20 time: 0.372833 Apr 13 21:45:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 24/71] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:45:16 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1276 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:45:16 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] validate_networks() for [('7401a99a-44e9-442d-8f64-8591e14e8388', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Creating event network-changed:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61665) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f66f15e6-0143-47f1-ac67-4f975469f272 req-020a7fb8-56a3-4536-b6c4-bfb45ad23ff0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61665) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:17 user devstack@n-api.service[61665]: INFO nova.compute.rpcapi [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 21:45:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] Releasing lock "compute-rpcapi-router" {{(pid=61665) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 21:45:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6ebdaf16-caa0-4f68-a405-db40bc45f31d None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214368 Apr 13 21:45:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 26/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting quotas for project d4235a17cc95422dacb6386d4952fc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Getting quotas for user c3c1bbf573ea436293abf4debdecc515 and project d4235a17cc95422dacb6386d4952fc8e. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] Creating event network-changed:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:45:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b4f2a2ea-29dc-4c8c-aecb-0306881d9d16 req-56ee7bfb-2694-4580-9860-8b343ee5729f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090864 Apr 13 21:45:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4c4dbafd-d80d-453a-b25e-b98e36a76dcf tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.294236 Apr 13 21:45:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 23/74] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-dc304b0e-5435-4240-828f-590d99d128bd tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-dc304b0e-5435-4240-828f-590d99d128bd tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-dc304b0e-5435-4240-828f-590d99d128bd tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-dc304b0e-5435-4240-828f-590d99d128bd tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1240 microversion: 2.1 time: 0.110512 Apr 13 21:45:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 27/75] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:18 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] Creating event network-changed:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:45:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ec96c0d1-6c60-4782-a878-a149fcff4b25 req-ed57295c-806f-413e-b138-0901441d5055 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033960 Apr 13 21:45:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Creating event network-changed:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-702ff9b7-053e-4bc7-936f-6158979590b1 req-6799108c-b69a-4f3b-9516-28e6113f0c96 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:21 user devstack@n-api.service[61664]: INFO nova.compute.rpcapi [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 13 21:45:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] Releasing lock "compute-rpcapi-router" {{(pid=61664) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 13 21:45:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-364c0d96-8d04-44a8-ad30-d15e92b2890e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085477 Apr 13 21:45:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 24/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:22 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:22 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] Creating event network-changed:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:45:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-2cb4bd66-2401-40d5-83fd-78adfddfa1d7 req-fd314a1f-08a0-42da-9c58-d5b22faa176b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031103 Apr 13 21:45:22 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 28/78] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] Creating event network-changed:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:45:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-43aee76a-974d-4874-beda-1a9c1434cda9 req-a6f7d6f9-0a36-4861-8966-91ad044ebb49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036822 Apr 13 21:45:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "name": "network-vif-plugged", "status": "completed", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] Creating event network-vif-plugged:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:45:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8b78e0ee-0db1-4ad9-9083-b1a7bb86fd62 req-e2235dd2-f4f8-409e-954c-6524bb5226b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Apr 13 21:45:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 25/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:45:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-05c790fb-d8c5-4a54-abe5-db8b908e898c req-82021838-d6f6-41af-99b7-b8cc3c007885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037011 Apr 13 21:45:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 29/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}, {"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}, {"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}, {"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:26 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:45:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:45:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:45:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:45:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-30e9093b-03e5-4a03-9273-ab3b8019dc1c req-ba8820ca-3cf5-4cdd-a730-78d3cec2745f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043060 Apr 13 21:45:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:26 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "name": "network-vif-plugged", "status": "completed", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] Creating event network-vif-plugged:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:45:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a235d912-dfcb-4b31-90e3-ccc3003717cf req-61fa6ce5-8d72-48e0-9c44-6fc6b01414c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045514 Apr 13 21:45:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 26/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:45:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-3d62b52f-3ffc-458d-929a-379f0a6412a4 req-56dfa8b5-2ce0-4beb-a443-a0dae7c70f8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044149 Apr 13 21:45:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 30/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=22 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "name": "network-vif-plugged", "status": "completed", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}, {"server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "name": "network-vif-plugged", "status": "completed", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Creating event network-vif-plugged:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:45:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] Creating event network-vif-plugged:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:45:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4d317235-3684-4f31-9f69-991219b86586 req-9a1dd36e-e64e-4a2d-b5c7-8de3b88f1f8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074666 Apr 13 21:45:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=20 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:45:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a5db2b3f-9b6b-4979-8831-e253fe59e160 req-6c9ad0dd-0257-4002-9c47-ab1a8ffb8dd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132846 Apr 13 21:45:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 27/86] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=26 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1fceda57-532b-4d14-81b7-f0c5343c002d tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d886050>, body: {"keypair": {"name": "tempest-keypair-1807131148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWC+Lq7pJ4WDwThJOzr5RF5FYGRTvTjYRBB7k91qrhwtm+D5lvNsjF+j5p20b80DTf/2gxHyYmsifkpGYyU2u3wq7jDQvSYZvn/fEGzUyBeRiZKX/bAu5xuVFp32HZsXw=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:34 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1fceda57-532b-4d14-81b7-f0c5343c002d tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting quotas for project ec8cec16877149a6824b9292c1065c13. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:34 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1fceda57-532b-4d14-81b7-f0c5343c002d tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting quotas for user f5b255efcd6b4033ba11cc64eb376a89 and project ec8cec16877149a6824b9292c1065c13. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1fceda57-532b-4d14-81b7-f0c5343c002d tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123139 Apr 13 21:45:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 31/87] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:45:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-933d17ba-3de5-4b0d-8410-3f526d2ea6ba tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d016200>, body: {"keypair": {"name": "tempest-keypair-1995468323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOVPDIms8lGQmxW0b6d+PIMb94QdlHp7hlh+Q/5jFinTckEYdyLh00UbgoM7ROLffK93N7l3ulRDVVB1s0zuiy0lE4iXR7lWtCVRO2tXqkvRZAl7MFNGrmKz7BzYb2Gyw=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:45:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:45:36 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-933d17ba-3de5-4b0d-8410-3f526d2ea6ba tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3dded727-e9fe-43ec-9fd3-c245cbe1988c req-42838a91-456c-45ef-a03d-d170797841c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095822 Apr 13 21:45:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 28/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:36 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-933d17ba-3de5-4b0d-8410-3f526d2ea6ba tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for user 97e87956414a49c4b3c34e51fe6ed2ec and project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-933d17ba-3de5-4b0d-8410-3f526d2ea6ba tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.542049 Apr 13 21:45:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 30/89] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:45:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1884922287", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "2c235eb0-e303-4d17-a1d6-b2a05c1adeb5"}], "security_groups": [{"name": "tempest-securitygroup--1765946426"}], "key_name": "tempest-keypair-1807131148", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:37 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=14 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:38 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] validate_networks() for [('2c235eb0-e303-4d17-a1d6-b2a05c1adeb5', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:45:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-822c0990-6510-456a-bf60-67d23b2e05e7 req-d6d1d5e4-2a1a-4967-a437-2081a3c654ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181094 Apr 13 21:45:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 29/90] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=20 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting quotas for project ec8cec16877149a6824b9292c1065c13. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Getting quotas for user f5b255efcd6b4033ba11cc64eb376a89 and project ec8cec16877149a6824b9292c1065c13. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:39 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1fb3b321-4e84-4fc4-aacf-b9aa79ec0036 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.454008 Apr 13 21:45:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 32/91] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:37 2023] POST /compute/v2.1/servers => generated 404 bytes in 2458 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-203c3265-d612-4a53-b52d-2a73a3a2f46e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-203c3265-d612-4a53-b52d-2a73a3a2f46e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-da11d8a4-679b-4f7d-a39c-8ea0ee57b34f tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d068790>, body: {"keypair": {"name": "tempest-keypair-370819211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFROVO+zm7q7MfconxyMxDki9e01Easmw29VJ/VqS+XvT8Z0ODRB772cwRCD/oqQmD8w9y32x+8FkKd6/URareT0Tt2jFEa6d7Cczm3AP49Fa7ACviOhVHEiiknpYk8Ig=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:40 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-da11d8a4-679b-4f7d-a39c-8ea0ee57b34f tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting quotas for project 6ddcd2da3f5e4a148bef3c7c4adce6db. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:40 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-da11d8a4-679b-4f7d-a39c-8ea0ee57b34f tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting quotas for user acd1c71dac2c4f2a810c2f4a6883fde9 and project 6ddcd2da3f5e4a148bef3c7c4adce6db. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:40 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-203c3265-d612-4a53-b52d-2a73a3a2f46e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b255efcd6b4033ba11cc64eb376a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8cec16877149a6824b9292c1065c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-203c3265-d612-4a53-b52d-2a73a3a2f46e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870" status: 200 len: 1226 microversion: 2.1 time: 0.329066 Apr 13 21:45:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:39 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 => generated 1226 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-da11d8a4-679b-4f7d-a39c-8ea0ee57b34f tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.804819 Apr 13 21:45:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 31/93] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:45:39 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-452847607", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "25a51e04-88d5-45b8-865b-f2c7da7460b1"}], "security_groups": [{"name": "tempest-securitygroup--165864205"}], "key_name": "tempest-keypair-1995468323", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:42 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] validate_networks() for [('25a51e04-88d5-45b8-865b-f2c7da7460b1', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for user 97e87956414a49c4b3c34e51fe6ed2ec and project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-11bedf3c-5397-4080-8c49-bc4603e83b6c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.521402 Apr 13 21:45:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 33/94] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3f2fcfcf-ca3b-41b5-bd3d-d9e70c8df0de tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3f2fcfcf-ca3b-41b5-bd3d-d9e70c8df0de tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3f2fcfcf-ca3b-41b5-bd3d-d9e70c8df0de tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3f2fcfcf-ca3b-41b5-bd3d-d9e70c8df0de tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e" status: 200 len: 1235 microversion: 2.1 time: 0.120743 Apr 13 21:45:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:43 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e => generated 1235 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1482021877", "imageRef": "dda98d66-c12c-4e6c-8424-49468954423b", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c"}], "security_groups": [{"name": "tempest-securitygroup--280726202"}], "key_name": "tempest-keypair-370819211", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:44 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] validate_networks() for [('b3e2aa8e-b9e5-4c60-8735-4142cdb6bc3c', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting quotas for project 6ddcd2da3f5e4a148bef3c7c4adce6db. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Getting quotas for user acd1c71dac2c4f2a810c2f4a6883fde9 and project 6ddcd2da3f5e4a148bef3c7c4adce6db. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dda98d66-c12c-4e6c-8424-49468954423b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6ac6cffa-e978-4aa7-97b3-c07820634fb3 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.792453 Apr 13 21:45:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 32/96] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:45:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:45:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-25856723-271a-47c7-8d52-7e515bccdeb4 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-25856723-271a-47c7-8d52-7e515bccdeb4 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:45 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-25856723-271a-47c7-8d52-7e515bccdeb4 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1c71dac2c4f2a810c2f4a6883fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddcd2da3f5e4a148bef3c7c4adce6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-25856723-271a-47c7-8d52-7e515bccdeb4 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 200 len: 1239 microversion: 2.1 time: 0.193423 Apr 13 21:45:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 34/97] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:45 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] Creating event network-changed:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:45:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9f9b172d-6ee6-41b8-b34b-fb3603475bb9 req-46740210-e896-4283-8039-f1d1f7a2f4ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056655 Apr 13 21:45:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1f8e23cc-aafb-4847-85ec-c1b84b24341f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d06ad40>, body: {"keypair": {"name": "tempest-keypair-1492294196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv5A5QM89WDKnsULhMuooVL+m28bgPV7OihZIzGssK7PgLTiXl/GrJAAaMRdz+PYZbhzGzt+oX5wWpDIz3NkiaY2vLH+14jBnJVm8Ym0U0jNo9V6zKnqyN1OlYdbXBS3Q=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:48 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-1f8e23cc-aafb-4847-85ec-c1b84b24341f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting quotas for project 2fd0897baf2c455c87ac9a330a673d8e. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:48 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-1f8e23cc-aafb-4847-85ec-c1b84b24341f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting quotas for user 18587f4671a34f568e00dbee3f33eb8b and project 2fd0897baf2c455c87ac9a330a673d8e. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1f8e23cc-aafb-4847-85ec-c1b84b24341f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.125124 Apr 13 21:45:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 33/99] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 21:45:48 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:45:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] Creating event network-changed:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:45:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-3d8a5bb1-4404-427c-be10-f47f0905fa1c req-1c0d1993-0c41-4a23-935b-ce8341237966 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043972 Apr 13 21:45:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 35/100] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=19 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] Creating event network-changed:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:45:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-cc97d355-3716-4008-9341-6d3918b5ddd8 req-fb5a4866-1932-49c7-98c8-9df37e73c5dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 Apr 13 21:45:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-155987669", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "887fc8b4-07a7-4f28-8a55-c09dc080941e"}], "security_groups": [{"name": "tempest-securitygroup--1489991691"}], "key_name": "tempest-keypair-1492294196", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "name": "network-vif-plugged", "status": "completed", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}, {"server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "name": "network-vif-plugged", "status": "completed", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Creating event network-vif-plugged:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:45:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] Creating event network-vif-plugged:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:45:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-86b4ace8-1632-468a-aa22-10844a4d7cf4 req-7d8ec684-b5d7-4295-b667-476cd91e5601 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048922 Apr 13 21:45:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 36/102] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] validate_networks() for [('887fc8b4-07a7-4f28-8a55-c09dc080941e', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting quotas for project 2fd0897baf2c455c87ac9a330a673d8e. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Getting quotas for user 18587f4671a34f568e00dbee3f33eb8b and project 2fd0897baf2c455c87ac9a330a673d8e. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:45:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:45:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5d1871c4-ac0d-4d7e-b88e-8c88f0d4409f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.686217 Apr 13 21:45:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 34/103] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:45:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:52 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:52 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:52 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6951c71a-979c-4a4b-82ee-35c2bd1a0e28 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 200 len: 1320 microversion: 2.49 time: 0.131120 Apr 13 21:45:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 34/104] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:45:51 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 1320 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "name": "network-vif-plugged", "status": "completed", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}, {"server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "name": "network-vif-plugged", "status": "completed", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=7 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Creating event network-vif-plugged:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:45:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] Creating event network-vif-plugged:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:45:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-e6edb955-bf72-4b9e-a99c-c495f75ae446 req-c2a12a5c-c30d-482f-88c9-ab98e86580e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038131 Apr 13 21:45:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 37/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:45:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "name": "network-vif-plugged", "status": "completed", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] Creating event network-vif-plugged:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:45:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-441b46ab-bc16-4ac0-a39d-8b65ff1d1afd req-694224e1-6e12-4305-a91b-acbf9fe5dd29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054092 Apr 13 21:45:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] Creating event network-changed:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:45:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c8a0e949-9e10-4472-871b-a6b7e24e943d req-ba5543ef-e06c-421b-b879-ac4587946a00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043450 Apr 13 21:45:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 35/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:56 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=18 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:45:56 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "name": "network-vif-plugged", "status": "completed", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] Creating event network-vif-plugged:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:45:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c0803df0-5af6-4569-bc5a-5e9d3c84b1ad req-c551c909-c10a-425c-ad62-716a841d4507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062040 Apr 13 21:45:56 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 38/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:58 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0be9c237-877a-49c8-8017-9f2a2b86afe8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1493 microversion: 2.1 time: 0.386283 Apr 13 21:45:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:57 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1493 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:45:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:45:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] Creating event network-vif-plugged:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:45:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-365be2c9-d497-4fe5-85c0-21d9471182fb req-6ffce194-7929-4607-9721-cdf74ff71ebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076540 Apr 13 21:45:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:45:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:45:59 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:45:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-672216c0-0068-4247-80bd-c688e4fb7e00 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1533 microversion: 2.1 time: 0.295008 Apr 13 21:45:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 39/111] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:45:58 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1533 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:00 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bd22640a-4f19-4ca5-9788-cbe88669355a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 200 len: 1503 microversion: 2.1 time: 0.236053 Apr 13 21:46:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 37/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:00 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] Creating event network-vif-plugged:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:46:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a6a5c84c-13f1-4256-b8d9-50b50a7e7af4 req-4252ebff-2964-4420-b704-ffba42145126 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056034 Apr 13 21:46:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:46:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7299dc5fc1ad4f3eb769eda4dac5abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aed26c3fb143cab8c3c1599f70d858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-72e2a873-6ec9-4659-8d1d-3af81e87d324 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 200 len: 1490 microversion: 2.1 time: 0.146865 Apr 13 21:46:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 40/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:04 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 1490 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=24 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=9 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a0c34a73-6739-40ad-9acd-cf298215cf53 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1586 microversion: 2.20 time: 0.160775 Apr 13 21:46:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:46:07 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1586 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=26 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6c12d927-eec8-477a-aa86-d9b1e73ca4aa tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1554 microversion: 2.1 time: 0.241949 Apr 13 21:46:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:09 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=7 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=24 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:30 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b255efcd6b4033ba11cc64eb376a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8cec16877149a6824b9292c1065c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-061ec3b6-40b2-4803-9e38-508b00044a7f tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870" status: 200 len: 1526 microversion: 2.1 time: 0.214180 Apr 13 21:46:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 41/117] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:30 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=24 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-50da308a-1ba2-4659-b147-7b4213aca049 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e" status: 200 len: 1545 microversion: 2.1 time: 0.188798 Apr 13 21:46:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 39/118] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:33 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e => generated 1545 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=13 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:36 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1c71dac2c4f2a810c2f4a6883fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddcd2da3f5e4a148bef3c7c4adce6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1bf83636-058d-4188-920a-aca304d4131c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 200 len: 1549 microversion: 2.1 time: 0.175675 Apr 13 21:46:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 39/119] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:35 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d2db42b9-04a9-4f9d-ad6f-448d923e1198 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: .version_select at 0x7f4b3d884940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1695743106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFrF4HyOOJH3pMivnghQrjFo+W8h3ND4pdRgXep1SFS8/WTYjcNCQm2ws2bOjH7uTrYfCv8CUrUqbd3voRDTocx9SqboUPZF+TWklO/M1CRGmsArlRpxU4SyKxVWG+qBZw=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-d2db42b9-04a9-4f9d-ad6f-448d923e1198 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:46:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-d2db42b9-04a9-4f9d-ad6f-448d923e1198 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for user 710e0446cf794e94b3ab29bb0d7e10d8 and project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:46:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d2db42b9-04a9-4f9d-ad6f-448d923e1198 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045806 Apr 13 21:46:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 42/120] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:46:36 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1041715874", "imageRef": "151f8298-2e7c-4c5b-b82a-496f9533b342", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1695743106", "networks": [{"uuid": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] validate_networks() for [('7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for user 710e0446cf794e94b3ab29bb0d7e10d8 and project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:46:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='151f8298-2e7c-4c5b-b82a-496f9533b342',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:46:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-044a6225-32e5-4cfa-9c61-2166a2c15951 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.507994 Apr 13 21:46:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 40/121] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:46:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:46:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bca8a535-5b8c-41ee-b7da-8af9949c6279 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bca8a535-5b8c-41ee-b7da-8af9949c6279 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:37 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bca8a535-5b8c-41ee-b7da-8af9949c6279 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bca8a535-5b8c-41ee-b7da-8af9949c6279 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1253 microversion: 2.1 time: 0.069411 Apr 13 21:46:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:36 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1253 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:39 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] Creating event network-changed:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:46:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-b76cf98c-08d3-44fd-b2dd-fb5f88e7e8fd req-48dc66d1-db28-4871-8045-b140653c6ee8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Apr 13 21:46:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:46:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:46:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-07004719-b7da-4296-9d12-908ee535485e req-982c5edb-c77f-4765-8165-f98930349494 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050203 Apr 13 21:46:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:46:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-576eaa16-259c-4a10-ba5a-4230693948cd tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 200 len: 1626 microversion: 2.49 time: 0.461593 Apr 13 21:46:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 41/125] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:46:42 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 1626 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:46:44 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:46:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d66d8e66-4a84-4790-a9b7-2ba9df7cb01a req-26c86cc8-8298-4aa6-946e-d4a2330709a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039832 Apr 13 21:46:44 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 44/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:46:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-386129097", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] validate_networks() for [('ed9169cc-af6d-4d31-9b2e-9016c5f963c4', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting quotas for project f1071d640fb44ff9966fab7888668ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Getting quotas for user 02a7fc7a42b441cfa3c6bc04f4dd6cb9 and project f1071d640fb44ff9966fab7888668ed5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:46:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:46:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a8930425-fe18-499a-862d-15cedb3187d8 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.521455 Apr 13 21:46:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 42/127] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:46:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=14 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-982f7ddd-2e4f-47b9-96ec-bc9222c70375 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-982f7ddd-2e4f-47b9-96ec-bc9222c70375 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:58 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-982f7ddd-2e4f-47b9-96ec-bc9222c70375 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:46:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-982f7ddd-2e4f-47b9-96ec-bc9222c70375 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 200 len: 1210 microversion: 2.1 time: 0.110784 Apr 13 21:46:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 42/128] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:46:58 2023] GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=10 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:46:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:46:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bf2b3f72-b21c-4726-a5fb-1def45099933 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.136559 Apr 13 21:46:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 45/129] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:46:59 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-interface => generated 282 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid 68cb788e-be1f-44fc-b65e-b908a5831ae2 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:47:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f59e7ab2-2c28-4b70-986a-e1c4829d0b44 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2/action" status: 200 len: 32 microversion: 2.1 time: 0.273476 Apr 13 21:47:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 43/130] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:47:00 2023] POST /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] Creating event network-changed:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:47:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-f8558bb1-a638-48ce-95b8-ca6f38729a43 req-c0737e8a-c8c2-427f-bff7-99dbd4955e52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032751 Apr 13 21:47:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 46/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a1ab74b5-d6cd-49e1-b4b1-143676da4f96 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/ips" status: 200 len: 102 microversion: 2.1 time: 0.054850 Apr 13 21:47:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 44/132] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:47:00 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/ips => generated 102 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:00 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a83b5216-dd15-47de-8305-cc0726c4dbb8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 200 len: 1509 microversion: 2.1 time: 0.252304 Apr 13 21:47:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 43/133] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:00 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] Creating event network-vif-unplugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:47:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c3c8fd05-ba78-4f0a-9506-4b7faa893a68 req-f4dbbd2d-a524-449a-a036-43b8efc0e006 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030161 Apr 13 21:47:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 47/134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c84a9a6-d73f-46ba-b157-ba2642a6a5ae"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3ec0f889-bb32-4732-aae9-ccac3c80f0ad tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592121 Apr 13 21:47:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 45/135] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:47:03 2023] POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}, {"name": "network-changed", "server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:47:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] Creating event network-changed:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:47:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d8fa4c84-c037-46f8-8575-377fba371300 req-05d3fa91-c3fd-4bb8-9b47-2ea984d802ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039625 Apr 13 21:47:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 44/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:04 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "name": "network-vif-plugged", "status": "completed", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] Creating event network-vif-plugged:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:47:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-b4df9446-251d-49f8-834c-d5ff0e2fd9d9 req-db748aa0-bce3-4e50-b0e8-3e557752c123 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037475 Apr 13 21:47:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}, {"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:47:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 21:47:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0d1e7138-fd3b-430d-9e91-17ac165e47ad req-6c9d1fba-aa1a-46a1-b392-a643d2f6161b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036575 Apr 13 21:47:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8880fa93-2a7f-4694-8158-f5da64668e3e"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7fe7c507-b15b-4c3e-8fb3-496f14f82ce5 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.453047 Apr 13 21:47:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 45/139] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:47:06 2023] POST /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4a548250-ebeb-4012-9f7b-2ea0e678d1b1 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.268299 Apr 13 21:47:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 49/140] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:47:07 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-interface => generated 282 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:47:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "name": "network-vif-plugged", "status": "completed", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] Creating event network-vif-plugged:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:47:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-09d12e25-47bc-4540-ae0f-394b5a6113b3 req-d6982653-c07d-4fb0-8a96-a280cc7362ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028713 Apr 13 21:47:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] Creating event network-changed:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c65348a1-f77a-460f-826b-76f5cf135c6b req-488bcc6b-82df-4c16-9448-ccdc9468481c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034441 Apr 13 21:47:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 46/142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5f5067da-ac1c-42f4-abd1-36295f83018b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/ips" status: 200 len: 109 microversion: 2.20 time: 0.036378 Apr 13 21:47:08 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 50/143] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 21:47:08 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5e09bb9b-1a2a-4737-8cf0-b1d6d236803b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.166175 Apr 13 21:47:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:47:09 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-interface => generated 283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-825801735"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] Creating event network-changed:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:47:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-dc7fbe5a-1989-47e5-b177-a33a156980a5 req-0231eff3-4bb9-4af8-b21b-ba088e7966d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044165 Apr 13 21:47:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 51/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:11 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'flavor' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:47:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-78ee0b3e-6dec-4c0b-b919-ba2d916ef5e6 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action" status: 202 len: 0 microversion: 2.1 time: 1.369986 Apr 13 21:47:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 47/146] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:47:10 2023] POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action => generated 0 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 21:47:11 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b33b0ce7-5668-4b6c-aad7-c4fff54d7413 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '.version_select at 0x7f4b3cf1f130>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:11 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b33b0ce7-5668-4b6c-aad7-c4fff54d7413 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02" status: 200 len: 1610 microversion: 2.1 time: 0.074438 Apr 13 21:47:11 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 52/147] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 21:47:11 2023] GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02 => generated 1610 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-40f88998-375e-4ba6-800d-6e0eb8f8657d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/action" status: 202 len: 0 microversion: 2.20 time: 1.178402 Apr 13 21:47:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 49/148] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:47:11 2023] POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/action => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:13 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:13 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:13 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-af49db76-1b34-4792-ba15-685e2390e915 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1709 microversion: 2.20 time: 0.280289 Apr 13 21:47:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 48/149] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:47:12 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1709 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:47:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:13 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] Creating event network-vif-unplugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:13 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d2f7023e-1144-41f6-9d46-a5941fc16a62 req-ee16a6cc-3530-480d-b12e-1718e6a28afd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033069 Apr 13 21:47:13 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 53/150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:14 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Going to try to stop instance {{(pid=61664) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 21:47:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-861122e9-f6d6-418a-bde1-34788813c584 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action" status: 202 len: 0 microversion: 2.1 time: 0.161966 Apr 13 21:47:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 50/151] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:47:13 2023] POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:14 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-cadb449a-6eb8-471c-a813-8babd2ee6b74 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1708 microversion: 2.1 time: 0.284753 Apr 13 21:47:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 49/152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:14 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1708 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-unplugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-unplugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] Creating event network-vif-unplugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:47:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d26aa163-13f1-4d9b-8a71-8961b435e964 req-355dbbac-7dbe-444e-9936-2a62a4eeb68e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.059598 Apr 13 21:47:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:47:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-0853e39b-795f-4263-b824-faabe290c4f9 req-644b45a5-7dee-4e0f-b7eb-682b28bf9bbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029050 Apr 13 21:47:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:47:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] Creating event network-changed:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:47:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-90888f89-ae91-445b-81a5-541d349bf402 req-84af14e7-314b-4e85-954d-36c2325abbfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Apr 13 21:47:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 55/155] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-faee07be-228e-40d6-9c1a-c03f8433120b tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 204 len: 0 microversion: 2.1 time: 0.125947 Apr 13 21:47:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 50/156] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:47:19 2023] DELETE /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:19 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7299dc5fc1ad4f3eb769eda4dac5abe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aed26c3fb143cab8c3c1599f70d858', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d04edaed-b29e-4165-acfe-9d100c3f14b4 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 200 len: 1542 microversion: 2.1 time: 0.189366 Apr 13 21:47:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:19 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 1542 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:21 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "name": "network-vif-unplugged", "status": "completed", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}, {"server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "name": "network-vif-plugged", "status": "completed", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}, {"server_uuid": "3a8e8627-03d4-4a17-a324-93def1017101", "name": "network-vif-deleted", "tag": "a9262ff5-d93b-430d-839d-39cdfccb47c4"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Creating event network-vif-unplugged:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:47:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Creating event network-vif-plugged:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:47:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] Creating event network-vif-deleted:a9262ff5-d93b-430d-839d-39cdfccb47c4 for instance 3a8e8627-03d4-4a17-a324-93def1017101 on user Apr 13 21:47:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-a6ba5359-7172-41d2-ad30-23f23f85f723 req-a869fa6d-d660-48a7-9128-ab119d6a59b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.031911 Apr 13 21:47:21 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 56/158] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-24f596d8-b5fc-4ac7-885e-f3d788493b8d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1537 microversion: 2.1 time: 0.151677 Apr 13 21:47:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 51/159] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:27 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1abbc07a-739a-4849-8bb9-81ea77c2ac39 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.115104 Apr 13 21:47:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:47:30 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-interface => generated 282 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=22 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=28 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] Creating event network-changed:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:47:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-fcec7048-5a2a-4ca0-a308-2d2e36681e7a req-64b8e162-0e1c-41ce-af13-338c6e974ae9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050615 Apr 13 21:47:32 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 57/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36939113-535a-44e7-a3b9-f81c95e278c4"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:47:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-13803fd4-e3c0-47d2-b876-619669322a33 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "POST /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412699 Apr 13 21:47:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 52/162] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:47:32 2023] POST /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e5a0edd2-dd73-46b2-98a4-5404197782ab tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.096423 Apr 13 21:47:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:47:33 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-interface => generated 283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] Creating event network-changed:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:47:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-6ffb5419-3e09-44f2-937a-cac7fd27f781 req-0cd63109-b2d0-4d17-93bc-7598e4dec388 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031744 Apr 13 21:47:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 58/164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0cd0ba20-2e38-4c79-a35f-c436bf640337 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.123331 Apr 13 21:47:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 53/165] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:47:36 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-interface => generated 283 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14774bd1-7eae-45fb-adfc-31c4d866a06d"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0f59a0ad-3b12-422a-aef1-1c53fb3da8d7 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309041 Apr 13 21:47:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 55/166] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:47:36 2023] POST /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] Creating event network-changed:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:47:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-ae8cd970-0ba4-4cdf-b220-7d3a6bfecb52 req-1905eebe-4547-4afb-8b14-8d836169e1ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042728 Apr 13 21:47:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 59/167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec590b36-5a34-4473-be50-d525f384e5da"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-39b677f5-4c5f-4fe8-9f11-3463e4d9d424 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272573 Apr 13 21:47:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 54/168] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:47:38 2023] POST /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "232f1088-3899-4c7b-afcb-b2847abf5b27"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5b9e0533-553c-4205-9ed9-6709d2751e71 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/36939113-535a-44e7-a3b9-f81c95e278c4" status: 202 len: 0 microversion: 2.1 time: 0.614549 Apr 13 21:47:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 56/169] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 21:47:40 2023] PUT /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/36939113-535a-44e7-a3b9-f81c95e278c4 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3f22327b-e587-40bf-ae11-f8dee1782be8 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.092417 Apr 13 21:47:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 60/170] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:47:42 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface => generated 282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:47:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] Creating event network-changed:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:47:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a0835d53-1e49-49b9-a096-6257ec9daaaa req-49c42793-7eb8-401d-89d0-804317f82d98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045312 Apr 13 21:47:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 55/171] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-41629e72-11cf-4a50-a7f3-6cab5246b80f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 200 len: 1626 microversion: 2.49 time: 0.201546 Apr 13 21:47:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 57/172] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:47:43 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 1626 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "ef33d497-2e44-4569-80c1-86dfb7a13837", "tag": "nic-tag"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0687164b-767a-45c7-ad7e-0f6794b23688"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] HTTP exception thrown: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Request method failure captured: Apr 13 21:47:44 user devstack@n-api.service[61663]: request: PUT /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments/14774bd1-7eae-45fb-adfc-31c4d866a06d HTTP/1.1 Apr 13 21:47:44 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:47:44 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:47:44 user devstack@n-api.service[61663]: Connection: close Apr 13 21:47:44 user devstack@n-api.service[61663]: Content-Length: 74 Apr 13 21:47:44 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:47:44 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:47:44 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:47:44 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHf_kcwKvwdLxdRCW-iFSvrb5FEvwSMF0pneyzwZbPU8SBYh6aIEjomrYL-wdtP8Sn22IyS-R85EXVNvjwQ17hBpPgP1WWs2WfovVlVu2mf2EdRgrR6lgFQBSXBOx_XQSyej2d3m_ZmsNEdJ8DeMxY72_Dsk5dCsrQeL22ZskJPWoMw Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Project-Id: 33ce178f7e7c41a3a56a745c7a0695b0 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Role: reader,admin,member Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Roles: reader,admin,member Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Tenant-Id: 33ce178f7e7c41a3a56a745c7a0695b0 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-User: tempest-VolumesAdminNegativeTest-596135765-project-admin Apr 13 21:47:44 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:47:44 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:47:44 user devstack@n-api.service[61663]: X-User-Id: 1ab670d2dfa84fa68a9421c36206e8e6 Apr 13 21:47:44 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesAdminNegativeTest-596135765-project-admin Apr 13 21:47:44 user devstack@n-api.service[61663]: Apr 13 21:47:44 user devstack@n-api.service[61663]: {"volumeAttachment": {"volumeId": "0687164b-767a-45c7-ad7e-0f6794b23688"}} Apr 13 21:47:44 user devstack@n-api.service[61663]: method: > Apr 13 21:47:44 user devstack@n-api.service[61663]: exception: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. Apr 13 21:47:44 user devstack@n-api.service[61663]: action_args: {'server_id': 'be81f393-654b-4b50-856e-00818f3ae59e', 'id': '14774bd1-7eae-45fb-adfc-31c4d866a06d', 'body': {'volumeAttachment': {'volumeId': '0687164b-767a-45c7-ad7e-0f6794b23688'}}} Apr 13 21:47:44 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. (HTTP 404) (Request-ID: req-19b8771b-a2e3-49f0-b55d-30d20c759861) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. Apr 13 21:47:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Returning 400 to user: Volume 0687164b-767a-45c7-ad7e-0f6794b23688 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:47:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6db1f9e9-d01f-4eae-9470-640237ea19d5 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments/14774bd1-7eae-45fb-adfc-31c4d866a06d" status: 400 len: 107 microversion: 2.1 time: 0.279394 Apr 13 21:47:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 56/173] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 21:47:44 2023] PUT /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments/14774bd1-7eae-45fb-adfc-31c4d866a06d => generated 107 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lazy-loading 'services' on Instance uuid be81f393-654b-4b50-856e-00818f3ae59e {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:47:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c952a265-3b6d-46ed-b085-bd4f29152d00 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments/14774bd1-7eae-45fb-adfc-31c4d866a06d" status: 202 len: 0 microversion: 2.1 time: 0.253905 Apr 13 21:47:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:47:44 2023] DELETE /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments/14774bd1-7eae-45fb-adfc-31c4d866a06d => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1e245699-3896-419d-8a30-aff7c4c4d994 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053360 Apr 13 21:47:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 57/175] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:44 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] Creating event network-changed:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:47:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9e41953d-a0f7-4023-9fd3-394b8798cf94 req-d8e45156-7850-48e6-80fa-01d20c8fa785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033283 Apr 13 21:47:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-743ba58d-93f8-4ef1-bec3-2381ca805ba8 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054346 Apr 13 21:47:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 58/177] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:46 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:46 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lazy-loading 'services' on Instance uuid c71cb46d-2737-4b94-8159-267ea4a0a296 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:47:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-15ae163f-dce4-4f0d-8e94-d8e2ff8d7061 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments/ec590b36-5a34-4473-be50-d525f384e5da" status: 202 len: 0 microversion: 2.1 time: 0.182918 Apr 13 21:47:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:47:46 2023] DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments/ec590b36-5a34-4473-be50-d525f384e5da => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e099885c-5fcc-4e36-a466-0c99746231f6 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.270669 Apr 13 21:47:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 61/179] 10.0.0.210 () {66 vars in 1414 bytes} [Thu Apr 13 21:47:43 2023] POST /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface => generated 283 bytes in 3273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f18b86-11cf-4281-8970-f6f9abe4ea96", "tag": "volume-tag"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a5cf4d2e-7efd-4d68-8515-a3fd8c029163 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.288329 Apr 13 21:47:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 59/180] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 21:47:47 2023] POST /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:47:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}, {"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Creating event network-vif-plugged:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:47:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] Creating event network-vif-plugged:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:47:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-a44f7f0a-9895-4f81-86c2-38b0b93e82ee req-02510f51-974c-4f54-84dd-a04e5099478b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062326 Apr 13 21:47:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 61/181] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:49 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d88a04db-d694-4a2b-8d1d-9fedd6a3a2f4 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 200 len: 1493 microversion: 2.1 time: 0.154297 Apr 13 21:47:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 62/182] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:49 2023] GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 1493 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2b2d66b0-d741-41aa-a9ea-8ae8be7fd18a tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073325 Apr 13 21:47:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 62/183] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:51 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-484d587c-acfe-467b-a0cd-aeeb78394040 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 200 len: 1489 microversion: 2.1 time: 0.266728 Apr 13 21:47:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 60/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:50 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 1489 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-db3ea6cf-847d-4d35-9248-29f78ac2729e tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058447 Apr 13 21:47:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:51 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:47:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e5f4f1d7-2a1c-43e3-8185-3ac671bae5d7 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 204 len: 0 microversion: 2.1 time: 0.202884 Apr 13 21:47:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:47:51 2023] DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1c71dac2c4f2a810c2f4a6883fde9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddcd2da3f5e4a148bef3c7c4adce6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:47:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2d77c463-88dd-479d-8c7a-f08b0e857d2c tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 200 len: 1674 microversion: 2.1 time: 0.258533 Apr 13 21:47:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 61/187] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:47:51 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 1674 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "name": "network-vif-unplugged", "status": "completed", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] Creating event network-vif-unplugged:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:47:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d6ef06c5-5a73-4545-a045-c590e02de1e9 req-cb55344c-0ebb-44f5-90c2-f7126a912e92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060883 Apr 13 21:47:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 64/188] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "name": "network-vif-plugged", "status": "completed", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] Creating event network-vif-plugged:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:47:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-49710e9c-8f25-4dfc-b540-37b9e1abab1a req-96e097e4-8ef4-4875-9e5b-84f3bfdfad98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051749 Apr 13 21:47:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:47:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71cb46d-2737-4b94-8159-267ea4a0a296", "name": "network-vif-deleted", "tag": "3a5a1230-3352-4342-80b2-5c87991a9b3d"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] Creating event network-vif-deleted:3a5a1230-3352-4342-80b2-5c87991a9b3d for instance c71cb46d-2737-4b94-8159-267ea4a0a296 on user Apr 13 21:47:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-eab4cab0-ce3d-42a7-b73d-838ab7bca5f2 req-de38ce43-9695-41c2-8cd5-c6488b2bc6c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054490 Apr 13 21:47:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 62/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:47:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9414bb32-4183-4898-a4d0-e588586e7484 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Apr 13 21:47:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:55 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2c434069-4e01-4dea-a926-f43c909949c4 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058260 Apr 13 21:47:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:47:55 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "36939113-535a-44e7-a3b9-f81c95e278c4"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e6833acc-4d80-408e-9df1-5d7b2c1260a1 tempest-TestVolumeSwap-63462098 tempest-TestVolumeSwap-63462098-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/232f1088-3899-4c7b-afcb-b2847abf5b27" status: 202 len: 0 microversion: 2.1 time: 0.307302 Apr 13 21:47:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 63/193] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 21:47:55 2023] PUT /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/232f1088-3899-4c7b-afcb-b2847abf5b27 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:47:58 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lazy-loading 'services' on Instance uuid ff61d99e-4db9-421f-8c01-264a7278c095 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:47:58 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-28c0aecb-9ead-4910-9d23-5fdaf3dbfb7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments/68f18b86-11cf-4281-8970-f6f9abe4ea96" status: 202 len: 0 microversion: 2.49 time: 0.250786 Apr 13 21:47:58 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 21:47:58 2023] DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments/68f18b86-11cf-4281-8970-f6f9abe4ea96 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-633c2ade-cf7b-4844-875b-1c9fdfc3612e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface/30cd1e3e-0642-43d5-816d-210deb9ace23" status: 202 len: 0 microversion: 2.49 time: 0.067714 Apr 13 21:48:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 66/195] 10.0.0.210 () {64 vars in 1507 bytes} [Thu Apr 13 21:48:00 2023] DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-interface/30cd1e3e-0642-43d5-816d-210deb9ace23 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-60171040-3265-4363-8b5c-790edea9e29b tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e" status: 200 len: 474 microversion: 2.49 time: 0.208397 Apr 13 21:48:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 64/196] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 21:48:00 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e => generated 474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:48:01 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-unplugged", "status": "completed", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] Creating event network-vif-unplugged:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-a4bb7acc-4b12-48ff-8d63-45559fbaa8dd req-f8486f7c-42a1-4891-bc92-ca5ab88148f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030676 Apr 13 21:48:01 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a6e1fedf-35e8-49a5-8551-f1cafcbb280c tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '.version_select at 0x7f4b3cd37b50>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a6e1fedf-35e8-49a5-8551-f1cafcbb280c tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02" status: 200 len: 1724 microversion: 2.1 time: 0.060223 Apr 13 21:48:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 21:48:01 2023] GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02 => generated 1724 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ad3ec32d-7568-439c-95e3-0031977501ab tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '.version_select at 0x7f4b3ce62830>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ad3ec32d-7568-439c-95e3-0031977501ab tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02" status: 200 len: 1724 microversion: 2.1 time: 0.054031 Apr 13 21:48:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 65/199] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 13 21:48:02 2023] GET /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02 => generated 1724 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=25 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:02 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bb3aece9-f21a-49ae-a40f-3aa2f3f04a95 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1673 microversion: 2.1 time: 0.209740 Apr 13 21:48:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 68/200] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:02 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}, {"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-deleted", "tag": "30cd1e3e-0642-43d5-816d-210deb9ace23"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:03 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=26 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Creating event network-vif-plugged:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] Creating event network-vif-deleted:30cd1e3e-0642-43d5-816d-210deb9ace23 for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7a7e0d91-e184-4e23-961d-d7fcee316127 req-e50ffba0-4d6b-48bf-9dc5-a3199df87351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071606 Apr 13 21:48:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 68/201] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:03 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f9d6ea01-fec2-40d1-9d1e-bcecc1bd6b70 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1650 microversion: 2.20 time: 0.265321 Apr 13 21:48:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 66/202] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:48:03 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1650 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ae61b87d-14fa-4921-a0ca-6b3f4edcd65b tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1685 microversion: 2.1 time: 0.242686 Apr 13 21:48:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 69/203] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:04 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1685 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4518c994-ae3a-45bd-bf69-4e8a7e845fb9 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046178 Apr 13 21:48:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:08 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e40665a5-03fe-444d-bf70-af231b87e8c1 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Apr 13 21:48:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 67/205] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:08 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lazy-loading 'services' on Instance uuid 35820c1d-307d-43ed-b3d1-31fe12602870 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:48:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-2e44ce05-0771-44cb-98b9-1402eda221ef tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/36939113-535a-44e7-a3b9-f81c95e278c4" status: 202 len: 0 microversion: 2.1 time: 0.151395 Apr 13 21:48:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 70/206] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:48:08 2023] DELETE /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments/36939113-535a-44e7-a3b9-f81c95e278c4 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7c25eb2f-8b88-4e3f-81e8-a83dad3aa776 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039398 Apr 13 21:48:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:09 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] HTTP exception thrown: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Request method failure captured: Apr 13 21:48:09 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 HTTP/1.1 Apr 13 21:48:09 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:48:09 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:48:09 user devstack@n-api.service[61663]: Connection: close Apr 13 21:48:09 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:48:09 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:48:09 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:48:09 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:48:09 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfoyW7Mkpx_hpl8vhi16PU61Xmq5f-fbILCE8LQT-DJ6Mk4_tYNxDI1cOqS3cKeMkwMFaR3WLtxU2AoB0cgIN7P8sP3vMkXFn24qZUILgh-TmiGfqIT3BBdqsN8wtfLH0ImLR6bLuGY23yCLjnvzMsMD7NLNmqpuCYkPNX3AucdmeI Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Project-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Project-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Tenant: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Tenant-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-User: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:09 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:48:09 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:48:09 user devstack@n-api.service[61663]: X-User-Id: 7299dc5fc1ad4f3eb769eda4dac5abe1 Apr 13 21:48:09 user devstack@n-api.service[61663]: X-User-Name: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:09 user devstack@n-api.service[61663]: method: > Apr 13 21:48:09 user devstack@n-api.service[61663]: exception: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61663]: action_args: {'id': '3a8e8627-03d4-4a17-a324-93def1017101'} Apr 13 21:48:09 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Returning 404 to user: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3933c185-261d-4e9b-aa01-b6e9b8874418 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 404 len: 111 microversion: 2.1 time: 0.044455 Apr 13 21:48:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:09 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] HTTP exception thrown: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Request method failure captured: Apr 13 21:48:09 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101/os-volume_attachments HTTP/1.1 Apr 13 21:48:09 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:48:09 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:48:09 user devstack@n-api.service[61665]: Connection: close Apr 13 21:48:09 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:48:09 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:48:09 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:48:09 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:48:09 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfoyW7Mkpx_hpl8vhi16PU61Xmq5f-fbILCE8LQT-DJ6Mk4_tYNxDI1cOqS3cKeMkwMFaR3WLtxU2AoB0cgIN7P8sP3vMkXFn24qZUILgh-TmiGfqIT3BBdqsN8wtfLH0ImLR6bLuGY23yCLjnvzMsMD7NLNmqpuCYkPNX3AucdmeI Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Project-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Project-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Tenant: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Tenant-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-User: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:09 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:48:09 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:48:09 user devstack@n-api.service[61665]: X-User-Id: 7299dc5fc1ad4f3eb769eda4dac5abe1 Apr 13 21:48:09 user devstack@n-api.service[61665]: X-User-Name: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:09 user devstack@n-api.service[61665]: method: > Apr 13 21:48:09 user devstack@n-api.service[61665]: exception: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61665]: action_args: {'server_id': '3a8e8627-03d4-4a17-a324-93def1017101'} Apr 13 21:48:09 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:09 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:48:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Returning 404 to user: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1e608152-9d98-4774-a1c8-96334c53c6cd tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033304 Apr 13 21:48:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:09 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] HTTP exception thrown: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Request method failure captured: Apr 13 21:48:13 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 HTTP/1.1 Apr 13 21:48:13 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:48:13 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:48:13 user devstack@n-api.service[61664]: Connection: close Apr 13 21:48:13 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:48:13 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:48:13 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:48:13 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:48:13 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfoyW7Mkpx_hpl8vhi16PU61Xmq5f-fbILCE8LQT-DJ6Mk4_tYNxDI1cOqS3cKeMkwMFaR3WLtxU2AoB0cgIN7P8sP3vMkXFn24qZUILgh-TmiGfqIT3BBdqsN8wtfLH0ImLR6bLuGY23yCLjnvzMsMD7NLNmqpuCYkPNX3AucdmeI Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Project-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Project-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Tenant: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Tenant-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-User: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:13 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:48:13 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:48:13 user devstack@n-api.service[61664]: X-User-Id: 7299dc5fc1ad4f3eb769eda4dac5abe1 Apr 13 21:48:13 user devstack@n-api.service[61664]: X-User-Name: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:13 user devstack@n-api.service[61664]: method: > Apr 13 21:48:13 user devstack@n-api.service[61664]: exception: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61664]: action_args: {'id': '3a8e8627-03d4-4a17-a324-93def1017101'} Apr 13 21:48:13 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Returning 404 to user: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f07150e0-d3fb-4340-91ce-a75e5e34a3cb tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 404 len: 111 microversion: 2.1 time: 0.038582 Apr 13 21:48:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:48:13 2023] DELETE /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] [instance: 3a8e8627-03d4-4a17-a324-93def1017101] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] HTTP exception thrown: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Request method failure captured: Apr 13 21:48:13 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 HTTP/1.1 Apr 13 21:48:13 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:48:13 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:48:13 user devstack@n-api.service[61663]: Connection: close Apr 13 21:48:13 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:48:13 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:48:13 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:48:13 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:48:13 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfoyW7Mkpx_hpl8vhi16PU61Xmq5f-fbILCE8LQT-DJ6Mk4_tYNxDI1cOqS3cKeMkwMFaR3WLtxU2AoB0cgIN7P8sP3vMkXFn24qZUILgh-TmiGfqIT3BBdqsN8wtfLH0ImLR6bLuGY23yCLjnvzMsMD7NLNmqpuCYkPNX3AucdmeI Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Project-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Project-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/45aed26c3fb143cab8c3c1599f70d858"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Tenant: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Tenant-Id: 45aed26c3fb143cab8c3c1599f70d858 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-DeleteServersTestJSON-698852050 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-User: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:13 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:48:13 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:48:13 user devstack@n-api.service[61663]: X-User-Id: 7299dc5fc1ad4f3eb769eda4dac5abe1 Apr 13 21:48:13 user devstack@n-api.service[61663]: X-User-Name: tempest-DeleteServersTestJSON-698852050-project-member Apr 13 21:48:13 user devstack@n-api.service[61663]: method: > Apr 13 21:48:13 user devstack@n-api.service[61663]: exception: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61663]: action_args: {'id': '3a8e8627-03d4-4a17-a324-93def1017101'} Apr 13 21:48:13 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. Apr 13 21:48:13 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] Returning 404 to user: Instance 3a8e8627-03d4-4a17-a324-93def1017101 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1dfd8226-3d42-4ef6-b92b-503a65d91e94 tempest-DeleteServersTestJSON-698852050 tempest-DeleteServersTestJSON-698852050-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101" status: 404 len: 111 microversion: 2.1 time: 0.039311 Apr 13 21:48:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 69/211] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:13 2023] GET /compute/v2.1/servers/3a8e8627-03d4-4a17-a324-93def1017101 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:23 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=7 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:23 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3fb1dbeb-f106-422b-bdee-070a9bb9c10b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cd80dc0>, body: {"keypair": {"name": "tempest-keypair-1140865131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjx8LeNe9cXNusDOj7TMicTJsVBbtNyG6GhcAtpINTGdELTCV12BHw/Zxcv95a+JyXlrpkKkk/ruhL3SgJFZa38BexE6t6zO+QIB6ZGe0sX/N0ToVLGcvJKAkLcITVBEw=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:23 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-3fb1dbeb-f106-422b-bdee-070a9bb9c10b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:48:23 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-3fb1dbeb-f106-422b-bdee-070a9bb9c10b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:48:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3fb1dbeb-f106-422b-bdee-070a9bb9c10b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149364 Apr 13 21:48:23 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 72/212] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:48:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-968149372", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c"}], "security_groups": [{"name": "tempest-securitygroup--1201005079"}], "key_name": "tempest-keypair-1140865131", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:24 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=7 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:24 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] validate_networks() for [('1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:48:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:48:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a69b75d7-14dc-4f08-bdc6-67379652959f tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.579149 Apr 13 21:48:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 72/213] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:48:24 2023] POST /compute/v2.1/servers => generated 407 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:48:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3ac04bce-9f13-49fc-b6c1-d67a929e5bb9 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3ac04bce-9f13-49fc-b6c1-d67a929e5bb9 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=7 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=15 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:25 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3ac04bce-9f13-49fc-b6c1-d67a929e5bb9 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3ac04bce-9f13-49fc-b6c1-d67a929e5bb9 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1232 microversion: 2.1 time: 0.075834 Apr 13 21:48:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 70/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:25 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1232 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7305c115-b08b-47ce-8531-cd6c8f980226 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1537 microversion: 2.1 time: 0.219887 Apr 13 21:48:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 73/215] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:27 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching by: {'deleted': False, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4'} {{(pid=61664) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61664]: DEBUG nova.compute.multi_cell_list [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61664) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 21:48:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f0caaa09-503a-48ea-971d-306e2eba1e8e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.241416 Apr 13 21:48:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 21:48:27 2023] GET /compute/v2.1/servers => generated 341 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-41802893-53bc-4843-bccc-9addcf73bb38 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1537 microversion: 2.1 time: 0.204624 Apr 13 21:48:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:27 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:28 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:28 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:28 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:28 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:28 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] Creating event network-changed:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:48:28 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-efebc61e-817b-4556-90d5-2824a0eb7e56 req-29d1f248-d9be-4135-b8bc-b252abd03b0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029522 Apr 13 21:48:28 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 74/218] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:48:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-29a413e0-9d86-474a-b67d-a4a28ad78c3c req-d9ceb060-472e-4da1-8ebb-a9b7b72746ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028368 Apr 13 21:48:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58713f9a-6c26-4fe7-a2bc-967c96ddcc4c"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ea2eda88-4ae6-447e-991c-baf828970fdd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279953 Apr 13 21:48:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 72/220] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:48:30 2023] POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:32 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:48:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-67592dff-ed2c-45b4-b5c7-b9790fe1da97 req-2d333856-d7df-485c-bddc-59213e532a45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047545 Apr 13 21:48:32 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 75/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f816105f-1aa5-4705-9047-f527ae2d9fc6 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046725 Apr 13 21:48:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:34 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1692528565", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "25a51e04-88d5-45b8-865b-f2c7da7460b1"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] validate_networks() for [('25a51e04-88d5-45b8-865b-f2c7da7460b1', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Getting quotas for user 97e87956414a49c4b3c34e51fe6ed2ec and project 03a67a9a0d514f19b6cc0b39477a1b42. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:48:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:48:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a1931f9b-1b7f-4ce9-8550-81d8b15e4f18 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.558003 Apr 13 21:48:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 73/223] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:48:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:48:35 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7a6b5a30-4dc6-418a-b95d-a392380d741a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:35 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7a6b5a30-4dc6-418a-b95d-a392380d741a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:35 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-7a6b5a30-4dc6-418a-b95d-a392380d741a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7a6b5a30-4dc6-418a-b95d-a392380d741a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413" status: 200 len: 1212 microversion: 2.1 time: 0.069641 Apr 13 21:48:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:35 2023] GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 => generated 1212 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] Creating event network-changed:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:48:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5a1aecf0-cbe8-40c5-82de-9de21ddb5806 req-f1dac193-7cae-4982-8959-f84c38615a03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033717 Apr 13 21:48:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "name": "network-vif-plugged", "status": "completed", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] Creating event network-vif-plugged:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:48:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3e083ced-17a0-4ddc-83c7-b0b9d7f0ceb3 req-9347120f-8d79-4383-acca-31872e4b16e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037751 Apr 13 21:48:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 74/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:41 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-743f7021-d9f9-4ab8-886a-bb93f52ce410 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1583 microversion: 2.1 time: 0.147961 Apr 13 21:48:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 77/227] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:40 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1583 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] HTTP exception thrown: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Request method failure captured: Apr 13 21:48:41 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 HTTP/1.1 Apr 13 21:48:41 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:48:41 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:48:41 user devstack@n-api.service[61664]: Connection: close Apr 13 21:48:41 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:48:41 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:48:41 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:48:41 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:48:41 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfmXX6GHDlL9mcCYEnRkmyQLe5BorKMROTsjesG99RTbWMRXzL-FdYCCIpm_hPoTwFqvQj5dZA2boKhSl78AjQYUCWAVBr2vfkrCz-eknkMuEPN9l4vYudnZnuJNyCzpvRsjlR1bPG4TY4i99bx42vboFFuP0fbav47eZhm-evltCA Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Project-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Tenant-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:41 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:41 user devstack@n-api.service[61664]: X-User: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:41 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:48:41 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:48:41 user devstack@n-api.service[61664]: X-User-Id: acd1c71dac2c4f2a810c2f4a6883fde9 Apr 13 21:48:41 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:41 user devstack@n-api.service[61664]: method: > Apr 13 21:48:41 user devstack@n-api.service[61664]: exception: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:41 user devstack@n-api.service[61664]: action_args: {'id': 'c71cb46d-2737-4b94-8159-267ea4a0a296'} Apr 13 21:48:41 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:41 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Returning 404 to user: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1eced990-5229-4192-b68c-b8eb14058033 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 404 len: 111 microversion: 2.1 time: 0.064426 Apr 13 21:48:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:41 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b56bbaf2-dc9a-4f3d-ab1a-80955ee8057b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '.version_select at 0x7f4b3cce31c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b56bbaf2-dc9a-4f3d-ab1a-80955ee8057b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-370819211" status: 202 len: 0 microversion: 2.1 time: 0.025999 Apr 13 21:48:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 75/229] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 21:48:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-370819211 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:48:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "name": "network-vif-plugged", "status": "completed", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] Creating event network-vif-plugged:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:48:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-f57b284b-3f9d-448e-8fe0-30865bcb3271 req-571571ac-d465-4e84-831a-e8f72e799cbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028487 Apr 13 21:48:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 78/230] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] Creating event network-changed:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d501737d-8142-435c-a3ed-7d7c2cac6372 req-382b268c-6de8-4d43-80bd-663b44c65cc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035096 Apr 13 21:48:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1527581578"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:44 user devstack@n-api.service[61663]: INFO nova.network.security_group_api [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Adding security group c30dc64d-6bc4-4dc8-acce-de46f39edad9 to port a6dc784b-1fab-4f4b-8e84-8df1f191b373 Apr 13 21:48:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3e673ba9-49b0-4bbf-b371-26792c885771 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action" status: 202 len: 0 microversion: 2.1 time: 0.647880 Apr 13 21:48:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 76/232] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:48:44 2023] POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] Creating event network-changed:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e93f1578-d6c4-4aec-a398-02fba202910d req-ee7b0572-5efe-48f4-abbd-e58e415932c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042015 Apr 13 21:48:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 79/233] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:45 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-26c31d1d-bdda-457e-a136-a5f6aa05067e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1749 microversion: 2.1 time: 0.284833 Apr 13 21:48:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:45 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1749 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] HTTP exception thrown: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Request method failure captured: Apr 13 21:48:46 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 HTTP/1.1 Apr 13 21:48:46 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:48:46 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:48:46 user devstack@n-api.service[61663]: Connection: close Apr 13 21:48:46 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:48:46 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:48:46 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:48:46 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:48:46 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfmXX6GHDlL9mcCYEnRkmyQLe5BorKMROTsjesG99RTbWMRXzL-FdYCCIpm_hPoTwFqvQj5dZA2boKhSl78AjQYUCWAVBr2vfkrCz-eknkMuEPN9l4vYudnZnuJNyCzpvRsjlR1bPG4TY4i99bx42vboFFuP0fbav47eZhm-evltCA Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Project-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Tenant-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:46 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61663]: X-User: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:46 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:48:46 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:48:46 user devstack@n-api.service[61663]: X-User-Id: acd1c71dac2c4f2a810c2f4a6883fde9 Apr 13 21:48:46 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:46 user devstack@n-api.service[61663]: method: > Apr 13 21:48:46 user devstack@n-api.service[61663]: exception: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61663]: action_args: {'id': 'c71cb46d-2737-4b94-8159-267ea4a0a296'} Apr 13 21:48:46 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Returning 404 to user: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3d316134-9a85-407a-8607-e8a66534366b tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 404 len: 111 microversion: 2.1 time: 0.044782 Apr 13 21:48:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 77/235] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:48:46 2023] DELETE /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] [instance: c71cb46d-2737-4b94-8159-267ea4a0a296] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] HTTP exception thrown: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Request method failure captured: Apr 13 21:48:46 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 HTTP/1.1 Apr 13 21:48:46 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:48:46 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:48:46 user devstack@n-api.service[61664]: Connection: close Apr 13 21:48:46 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:48:46 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:48:46 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:48:46 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:48:46 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfmXX6GHDlL9mcCYEnRkmyQLe5BorKMROTsjesG99RTbWMRXzL-FdYCCIpm_hPoTwFqvQj5dZA2boKhSl78AjQYUCWAVBr2vfkrCz-eknkMuEPN9l4vYudnZnuJNyCzpvRsjlR1bPG4TY4i99bx42vboFFuP0fbav47eZhm-evltCA Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Project-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ddcd2da3f5e4a148bef3c7c4adce6db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Tenant-Id: 6ddcd2da3f5e4a148bef3c7c4adce6db Apr 13 21:48:46 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-499777998 Apr 13 21:48:46 user devstack@n-api.service[61664]: X-User: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:46 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:48:46 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:48:46 user devstack@n-api.service[61664]: X-User-Id: acd1c71dac2c4f2a810c2f4a6883fde9 Apr 13 21:48:46 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-499777998-project-member Apr 13 21:48:46 user devstack@n-api.service[61664]: method: > Apr 13 21:48:46 user devstack@n-api.service[61664]: exception: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61664]: action_args: {'id': 'c71cb46d-2737-4b94-8159-267ea4a0a296'} Apr 13 21:48:46 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. Apr 13 21:48:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:48:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] Returning 404 to user: Instance c71cb46d-2737-4b94-8159-267ea4a0a296 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:48:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a4db5f02-2f5f-4614-b5f4-0d778ad962c6 tempest-AttachSCSIVolumeTestJSON-499777998 tempest-AttachSCSIVolumeTestJSON-499777998-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296" status: 404 len: 111 microversion: 2.1 time: 0.031897 Apr 13 21:48:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 80/236] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:46 2023] GET /compute/v2.1/servers/c71cb46d-2737-4b94-8159-267ea4a0a296 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-543a5d6a-a26e-4ec3-8763-6a729cf9b926 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action" status: 202 len: 0 microversion: 2.1 time: 0.148659 Apr 13 21:48:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 80/237] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:48:49 2023] POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:48:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3b4b7a84-f249-49c9-9105-36f11f1d4b09 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 204 len: 0 microversion: 2.1 time: 0.121530 Apr 13 21:48:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:48:49 2023] DELETE /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7bafa33f-329a-49b4-ae52-f6528f292178 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 200 len: 1499 microversion: 2.1 time: 0.251726 Apr 13 21:48:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:49 2023] GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 1499 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:49 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-571a57fe-eacb-4df7-a493-c70f0ec5ccd8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1751 microversion: 2.1 time: 0.533193 Apr 13 21:48:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 78/240] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:49 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1751 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "name": "network-vif-unplugged", "status": "completed", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] Creating event network-vif-unplugged:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:48:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-390b9282-10f6-4f89-bcf9-63949c8122ab req-33d71ab8-9b53-4db1-9f69-dd3be69a4b4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031022 Apr 13 21:48:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 82/241] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8286d3c5-4770-4256-918d-3c0533824732 tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e" status: 200 len: 503 microversion: 2.49 time: 0.091462 Apr 13 21:48:50 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 82/242] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 21:48:50 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e => generated 503 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "name": "network-vif-deleted", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] Creating event network-vif-deleted:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:48:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4b3644e1-045b-47e8-b967-6975cf949cbc req-5e2e9448-3d30-4c77-af33-c93d7a714294 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037772 Apr 13 21:48:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 83/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f972ea66-994a-4ec0-b0a3-081bda091daf tempest-TaggedAttachmentsTest-604688574 tempest-TaggedAttachmentsTest-604688574-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e" status: 200 len: 503 microversion: 2.49 time: 0.069986 Apr 13 21:48:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 79/244] 10.0.0.210 () {64 vars in 1537 bytes} [Thu Apr 13 21:48:50 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-instance-actions/req-633c2ade-cf7b-4844-875b-1c9fdfc3612e => generated 503 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-fe7d2a30-0caf-4ca1-8ce8-7917a85dfc8e tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.055057 Apr 13 21:48:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 83/245] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 21:48:51 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e731d926-6dfc-4d53-8ea6-1b3832e040ce tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 204 len: 0 microversion: 2.49 time: 0.121117 Apr 13 21:48:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 84/246] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:48:51 2023] DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c37e7aff-2894-43e1-9b67-c964949859db tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1503 microversion: 2.1 time: 0.166121 Apr 13 21:48:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 80/247] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:51 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:51 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18587f4671a34f568e00dbee3f33eb8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd0897baf2c455c87ac9a330a673d8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d90cd545-1e49-443f-b262-2d1efe9751f7 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 200 len: 1751 microversion: 2.49 time: 0.367485 Apr 13 21:48:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 84/248] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:48:51 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 1751 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f", "name": "network-vif-plugged", "status": "completed", "tag": "2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea"}, {"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-unplugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}, {"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Creating event network-vif-plugged:2dfaa3c7-5cbc-4cea-9c22-7e5a770338ea for instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f on user Apr 13 21:48:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Creating event network-vif-unplugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e93a3be6-1adc-45af-9ade-0d5b47883707 req-e8537092-f5b4-48a3-b7a5-d10015bdb598 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.036879 Apr 13 21:48:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 85/249] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:51 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-unplugged", "status": "completed", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}, {"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-plugged", "status": "completed", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Creating event network-vif-unplugged:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] Creating event network-vif-plugged:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c56792a0-e9a0-4138-89b3-4cbc2bf91a80 req-11d83963-ad9c-4a27-995b-e75d174a9f06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034590 Apr 13 21:48:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 81/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:52 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff61d99e-4db9-421f-8c01-264a7278c095", "name": "network-vif-deleted", "tag": "8c222f8e-f61d-4b04-87c4-edd1ca83b22b"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:55 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] Creating event network-vif-deleted:8c222f8e-f61d-4b04-87c4-edd1ca83b22b for instance ff61d99e-4db9-421f-8c01-264a7278c095 on user Apr 13 21:48:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-96f35930-dd3f-48e2-b026-40c581e4aefc req-8575ba3a-55bb-4212-9ef0-05137e3bf861 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057366 Apr 13 21:48:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:55 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-52a2d7f0-96d2-45bb-9520-c84587e1bb99 req-4c5bcbd1-ead4-494a-953c-cc2413b9ddba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052173 Apr 13 21:48:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 86/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:48:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:48:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-aef09fdb-f5d8-4c98-965a-131b38cb5dac req-f2191829-a84f-4078-a48b-3c2f57bfb9d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045698 Apr 13 21:48:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 82/253] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4e7118f6-15a8-4ec1-a16d-e14bd9d0f906 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046659 Apr 13 21:48:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:48:59 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:48:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a10ef218-547d-4a7c-9e04-985bbb52aa67 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870" status: 204 len: 0 microversion: 2.1 time: 0.157832 Apr 13 21:48:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 87/255] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:48:59 2023] DELETE /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:48:59 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5b255efcd6b4033ba11cc64eb376a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8cec16877149a6824b9292c1065c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:48:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-14ba4dee-1aa1-4a8a-8ad0-020ab6e0396e tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870" status: 200 len: 1651 microversion: 2.1 time: 0.284868 Apr 13 21:48:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 83/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:48:59 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 => generated 1651 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "name": "network-vif-unplugged", "status": "completed", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:48:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] Creating event network-vif-unplugged:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:49:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-2acbf9a7-632e-482f-aa5a-656c0af83668 req-cd437e1e-aef0-4ddf-a0fa-8e393c6d4fa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038725 Apr 13 21:49:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:48:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:49:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "name": "network-vif-plugged", "status": "completed", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] Creating event network-vif-plugged:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:49:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35820c1d-307d-43ed-b3d1-31fe12602870", "name": "network-vif-deleted", "tag": "015b54d3-245f-448a-b918-e53aaeed180f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ba035990-69c7-412b-8844-7d41b5088316 req-5cf0d2f8-58cb-4669-aab0-61be14175592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042211 Apr 13 21:49:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 88/258] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] Creating event network-vif-deleted:015b54d3-245f-448a-b918-e53aaeed180f for instance 35820c1d-307d-43ed-b3d1-31fe12602870 on user Apr 13 21:49:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-207ca2b8-3dca-4a1c-a667-b4489f3046f1 req-733121a0-6d1b-4bce-9766-d528b8d55a0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032375 Apr 13 21:49:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 84/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:03 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-cd4d86f9-cc57-4590-944a-993465eb2b49 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1673 microversion: 2.1 time: 0.257044 Apr 13 21:49:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:02 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1673 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1503190655", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "5f022439-52f7-4c06-a4f9-6943fddcd352"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] validate_networks() for [('5f022439-52f7-4c06-a4f9-6943fddcd352', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a325d973-036d-409b-af0a-cae00a2d5474"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for user 0ab740920cac4befac62a72f7ce5a817 and project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:49:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a2ba3699-b248-433a-9f5b-06d59fd9be3a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.406476 Apr 13 21:49:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 85/261] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 21:49:03 2023] POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments => generated 188 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:49:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:49:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b2272440-8747-428d-8131-be904ec8a7b2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.704051 Apr 13 21:49:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 89/262] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:49:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:49:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a2bfd06b-9eff-4ff5-97d7-fca77d419e78 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 200 len: 1395 microversion: 2.87 time: 0.093533 Apr 13 21:49:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 89/263] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:03 2023] GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61663) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 21:49:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-edc387f5-f377-4700-a430-65a4d61184b4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/action" status: 202 len: 0 microversion: 2.20 time: 0.131486 Apr 13 21:49:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 86/264] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:49:04 2023] POST /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-06783057-8bc5-4561-9092-96e9f67425e4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1736 microversion: 2.20 time: 0.194569 Apr 13 21:49:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 90/265] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:04 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Going to try to start instance {{(pid=61665) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 21:49:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5b16c143-c675-44bb-960b-103e3706c1e4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action" status: 202 len: 0 microversion: 2.1 time: 0.185158 Apr 13 21:49:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 90/266] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:49:04 2023] POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:05 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-385ff7c7-e6a5-4e16-a821-344f32a607ac tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1694 microversion: 2.1 time: 0.160862 Apr 13 21:49:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 87/267] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:04 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b928772-e4f8-489b-93b3-282f3c7c184b"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2369c18b-a019-43e7-a11b-ecb05bbf8c2b tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307069 Apr 13 21:49:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 91/268] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:49:05 2023] POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] Creating event network-changed:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 21:49:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-07829766-005e-4943-aa3e-77952eceeda7 req-a7bd5802-b2be-4e27-9091-0f99e1379011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029386 Apr 13 21:49:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 91/269] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] Creating event network-vif-plugged:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 21:49:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-37468e07-a1de-479d-9703-81491cb5032c req-39ce5496-4d79-47fa-854d-6daa228f61fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032569 Apr 13 21:49:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 88/270] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:49:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-123098cd-807d-4340-8284-c3a018c20ecf req-35492a77-9077-487f-b315-3a18b263fe6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Apr 13 21:49:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 92/271] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:13 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] Creating event network-vif-plugged:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 21:49:13 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-82a43cb3-a910-4189-a0e4-5de42c4be9c4 req-fb9f262f-19b1-4655-a847-cf9f55ed09a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027710 Apr 13 21:49:13 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "681d671a-5206-4f33-9bd7-d9abc8678d02"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}, {"name": "network-changed", "server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:13 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'flavor' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:49:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:49:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] Creating event network-changed:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:49:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9bfd0d2a-54cc-40cc-b357-bf68028712c1 req-2af810de-2609-49ff-80c9-342fc9b6ba8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045417 Apr 13 21:49:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 93/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-feea3247-66a6-4fe8-af52-fb6494f867ca tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action" status: 200 len: 29 microversion: 2.1 time: 0.315642 Apr 13 21:49:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 89/274] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:49:13 2023] POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action => generated 29 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:14 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:14 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b5f1663f-e983-413e-bd7c-1a4902cdf86d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1725 microversion: 2.1 time: 0.293155 Apr 13 21:49:14 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 93/275] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:13 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] Creating event network-vif-unplugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:49:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d5ba495a-eeb7-4a26-9b8b-66b835c0145a req-1ddab3b0-dbb0-4a72-b6b8-2a60499945d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054664 Apr 13 21:49:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 90/276] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:15 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5df1ba22-b96e-4a1f-8baf-b2ae6c1a2074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1539 microversion: 2.1 time: 0.208926 Apr 13 21:49:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 94/277] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:15 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1539 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:49:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-51072e53-adb3-4c5a-baa9-856c6436e5e8 req-80b6ce95-111f-450a-838f-880a215931cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039812 Apr 13 21:49:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 94/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:49:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5ddc56bc-0cb5-4957-97f7-b78853928061 req-c3b0134a-4696-478d-b7c9-ba0c25a5b557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 Apr 13 21:49:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 91/279] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:24 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:24 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:49:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:49:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:49:24 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-53863ea0-6140-4d37-80c2-f075e02ca1d8 req-de64bc1e-348f-4859-995f-2560ad6180e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041784 Apr 13 21:49:24 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 95/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:26 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:26 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-333e8014-9a64-4ee7-be5c-77b6db0d25f8 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413" status: 200 len: 1496 microversion: 2.1 time: 0.184257 Apr 13 21:49:26 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:25 2023] GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 => generated 1496 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] HTTP exception thrown: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:49:39 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f HTTP/1.1 Apr 13 21:49:39 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:49:39 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:49:39 user devstack@n-api.service[61663]: Connection: close Apr 13 21:49:39 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:49:39 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:49:39 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:49:39 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:49:39 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:49:39 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:49:39 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:49:39 user devstack@n-api.service[61663]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:49:39 user devstack@n-api.service[61663]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:49:39 user devstack@n-api.service[61663]: method: > Apr 13 21:49:39 user devstack@n-api.service[61663]: exception: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:49:39 user devstack@n-api.service[61663]: action_args: {'id': 'eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f'} Apr 13 21:49:39 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:49:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 404 to user: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:49:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-86db6759-f15b-437a-ba1d-92f51be35cf6 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 404 len: 111 microversion: 2.1 time: 0.039332 Apr 13 21:49:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 92/282] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:39 2023] GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=25 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:39 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-91b83d5a-2016-4aed-a3a8-1a37d4993868 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1493 microversion: 2.1 time: 0.151330 Apr 13 21:49:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 96/283] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:39 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1493 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:49:40 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e041c297-85fc-47a7-b783-253c4a7faa22 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1749 microversion: 2.1 time: 0.180537 Apr 13 21:49:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:39 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] HTTP exception thrown: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Request method failure captured: Apr 13 21:49:41 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 HTTP/1.1 Apr 13 21:49:41 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:49:41 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:49:41 user devstack@n-api.service[61663]: Connection: close Apr 13 21:49:41 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:49:41 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:49:41 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:49:41 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:49:41 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfpWtga6d_fEBcwOPYra0OS3miHJwjfLYNsUHvq-AqfVN1Kq1uWn4Z8cRRalIrQEGdgDwl02oUKe6FIU2uszSmjkzZletvqmDNEtsJ_SyHUwI00rqj6seN2N7YM6AC5nCuIpAV4i6LGQxZxzfMLnJytpvmc2AqFjv7QYiBANsxDLbw Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Project-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Tenant-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:41 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:41 user devstack@n-api.service[61663]: X-User: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:41 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:49:41 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:49:41 user devstack@n-api.service[61663]: X-User-Id: 18587f4671a34f568e00dbee3f33eb8b Apr 13 21:49:41 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:41 user devstack@n-api.service[61663]: method: > Apr 13 21:49:41 user devstack@n-api.service[61663]: exception: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:41 user devstack@n-api.service[61663]: action_args: {'id': 'ff61d99e-4db9-421f-8c01-264a7278c095'} Apr 13 21:49:41 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Returning 404 to user: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:49:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-289989d9-1605-4f41-b000-e19c4c520950 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 404 len: 111 microversion: 2.49 time: 0.028769 Apr 13 21:49:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 93/285] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:41 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:49:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7a10b371-25a8-4b32-a990-895937812238 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '.version_select at 0x7f4b3cd81870>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7a10b371-25a8-4b32-a990-895937812238 tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492294196" status: 204 len: 0 microversion: 2.49 time: 0.022386 Apr 13 21:49:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 97/286] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 21:49:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492294196 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] HTTP exception thrown: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Request method failure captured: Apr 13 21:49:43 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 HTTP/1.1 Apr 13 21:49:43 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:49:43 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:49:43 user devstack@n-api.service[61664]: Connection: close Apr 13 21:49:43 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:49:43 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:49:43 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:49:43 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:49:43 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfpWtga6d_fEBcwOPYra0OS3miHJwjfLYNsUHvq-AqfVN1Kq1uWn4Z8cRRalIrQEGdgDwl02oUKe6FIU2uszSmjkzZletvqmDNEtsJ_SyHUwI00rqj6seN2N7YM6AC5nCuIpAV4i6LGQxZxzfMLnJytpvmc2AqFjv7QYiBANsxDLbw Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Project-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Project-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Tenant: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Tenant-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:43 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61664]: X-User: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:43 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:49:43 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:49:43 user devstack@n-api.service[61664]: X-User-Id: 18587f4671a34f568e00dbee3f33eb8b Apr 13 21:49:43 user devstack@n-api.service[61664]: X-User-Name: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:43 user devstack@n-api.service[61664]: method: > Apr 13 21:49:43 user devstack@n-api.service[61664]: exception: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61664]: action_args: {'id': 'ff61d99e-4db9-421f-8c01-264a7278c095'} Apr 13 21:49:43 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Returning 404 to user: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:49:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8e612635-c127-4ccb-acca-6c9908f1de7b tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 404 len: 111 microversion: 2.49 time: 0.032331 Apr 13 21:49:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 97/287] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:49:43 2023] DELETE /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] [instance: ff61d99e-4db9-421f-8c01-264a7278c095] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] HTTP exception thrown: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Request method failure captured: Apr 13 21:49:43 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 HTTP/1.1 Apr 13 21:49:43 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:49:43 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:49:43 user devstack@n-api.service[61663]: Connection: close Apr 13 21:49:43 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:49:43 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:49:43 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:49:43 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:49:43 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfpWtga6d_fEBcwOPYra0OS3miHJwjfLYNsUHvq-AqfVN1Kq1uWn4Z8cRRalIrQEGdgDwl02oUKe6FIU2uszSmjkzZletvqmDNEtsJ_SyHUwI00rqj6seN2N7YM6AC5nCuIpAV4i6LGQxZxzfMLnJytpvmc2AqFjv7QYiBANsxDLbw Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.49 Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Project-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2fd0897baf2c455c87ac9a330a673d8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Tenant-Id: 2fd0897baf2c455c87ac9a330a673d8e Apr 13 21:49:43 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1835832502 Apr 13 21:49:43 user devstack@n-api.service[61663]: X-User: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:43 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:49:43 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:49:43 user devstack@n-api.service[61663]: X-User-Id: 18587f4671a34f568e00dbee3f33eb8b Apr 13 21:49:43 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedAttachmentsTest-1835832502-project-member Apr 13 21:49:43 user devstack@n-api.service[61663]: method: > Apr 13 21:49:43 user devstack@n-api.service[61663]: exception: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61663]: action_args: {'id': 'ff61d99e-4db9-421f-8c01-264a7278c095'} Apr 13 21:49:43 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. Apr 13 21:49:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:49:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] Returning 404 to user: Instance ff61d99e-4db9-421f-8c01-264a7278c095 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:49:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3a772e41-ce70-4863-9fde-27b0e47edb1f tempest-TaggedAttachmentsTest-1835832502 tempest-TaggedAttachmentsTest-1835832502-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095" status: 404 len: 111 microversion: 2.49 time: 0.053234 Apr 13 21:49:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 94/288] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:43 2023] GET /compute/v2.1/servers/ff61d99e-4db9-421f-8c01-264a7278c095 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] [instance: 35820c1d-307d-43ed-b3d1-31fe12602870] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] HTTP exception thrown: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Request method failure captured: Apr 13 21:49:49 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 HTTP/1.1 Apr 13 21:49:49 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:49:49 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:49:49 user devstack@n-api.service[61665]: Connection: close Apr 13 21:49:49 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:49:49 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:49:49 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:49:49 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:49:49 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfesRwKY9c-jzRFr7XMIH8vr3a6x00bcAwY-XZ46QHiMaYa_imRZQDikP2lMS4ORHjv2arzR1vxsKYottDmawoiA-fqhktBmc6J4B6XIcYIVVO7EihM-ku4k9Rbq9wc0z_C_uKM9-QSAv0htQwkbFr7c02L6fPxQM_-HnEbLfljUto Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Project-Id: ec8cec16877149a6824b9292c1065c13 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeSwap-1367203583 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec8cec16877149a6824b9292c1065c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec8cec16877149a6824b9292c1065c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec8cec16877149a6824b9292c1065c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeSwap-1367203583 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Tenant-Id: ec8cec16877149a6824b9292c1065c13 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeSwap-1367203583 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeSwap-1367203583-project-member Apr 13 21:49:49 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:49:49 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:49:49 user devstack@n-api.service[61665]: X-User-Id: f5b255efcd6b4033ba11cc64eb376a89 Apr 13 21:49:49 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeSwap-1367203583-project-member Apr 13 21:49:49 user devstack@n-api.service[61665]: method: > Apr 13 21:49:49 user devstack@n-api.service[61665]: exception: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. Apr 13 21:49:49 user devstack@n-api.service[61665]: action_args: {'id': '35820c1d-307d-43ed-b3d1-31fe12602870'} Apr 13 21:49:49 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. Apr 13 21:49:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:49:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Returning 404 to user: Instance 35820c1d-307d-43ed-b3d1-31fe12602870 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:49:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6fae1068-841c-4824-b5f1-0c99acee5216 tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870" status: 404 len: 111 microversion: 2.1 time: 0.028860 Apr 13 21:49:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 98/289] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:49 2023] GET /compute/v2.1/servers/35820c1d-307d-43ed-b3d1-31fe12602870 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:49:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f36def4c-2513-43a7-a3f4-ca6f1f65232b tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] Calling method '.version_select at 0x7f4b3cad6200>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f36def4c-2513-43a7-a3f4-ca6f1f65232b tempest-TestVolumeSwap-1367203583 tempest-TestVolumeSwap-1367203583-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807131148" status: 202 len: 0 microversion: 2.1 time: 0.023704 Apr 13 21:49:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 21:49:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1807131148 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:53 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:49:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-759e0cfe-5a90-45cf-91bb-9ae12d77ef08 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/action" status: 200 len: 32 microversion: 2.1 time: 0.126908 Apr 13 21:49:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 95/291] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:49:53 2023] POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9fc0dac4-4866-4592-bff5-0eebb1a8e54e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 200 len: 1691 microversion: 2.87 time: 0.340631 Apr 13 21:49:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 99/292] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:54 2023] GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 1691 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:49:54 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-dd9d4e7c-f9ee-40cd-a228-4bca1881913f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1509 microversion: 2.1 time: 0.454450 Apr 13 21:49:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 99/293] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:54 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1509 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4a765b48-98b5-4839-a8c1-61509e72a825 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1781 microversion: 2.20 time: 0.307732 Apr 13 21:49:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 96/294] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:49:54 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1781 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:49:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] Creating event network-vif-unplugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:49:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-104a1836-20c2-4994-bd42-29a97fb914e8 req-c0326087-3e22-41e4-a757-02febd5d3079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034823 Apr 13 21:49:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:55 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:49:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-90a6af38-72c4-4c74-b8c3-1697c01b4989 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1698 microversion: 2.1 time: 0.167957 Apr 13 21:49:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:49:55 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:49:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:49:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d20818a3-328a-4df2-aa87-4ba696aef2f8 req-3304ca48-644a-4597-91e1-2816cbfe4833 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028865 Apr 13 21:49:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 97/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:49:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}, {"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:49:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:49:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:49:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:49:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:49:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:49:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b00ed59f-af9b-4af1-8b01-4c97456b96fd req-1b05f9fa-8d75-49cf-9e7a-5e3a065a1aa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031564 Apr 13 21:49:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 101/298] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:49:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4305751f-f2db-4052-b3ef-7c0338745b65 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1705 microversion: 2.1 time: 0.316802 Apr 13 21:50:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:04 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1705 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-21be1695-970c-4eb2-a4e6-7769936d827b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.105632 Apr 13 21:50:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 98/300] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:50:15 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=26 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] Creating event network-changed:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:50:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5d721f93-b952-4996-b15a-3d5812fd5899 req-15a38e3a-762f-4b9e-85b7-f787a38d1cb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247164 Apr 13 21:50:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 102/301] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:17 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-eb9c220f-2850-4bbb-8908-ffb3912edbc6 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1539 microversion: 2.1 time: 0.245572 Apr 13 21:50:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 102/302] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:16 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:17 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c0391312-b6d7-4abb-896f-88ba56f996eb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1539 microversion: 2.1 time: 0.173939 Apr 13 21:50:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 99/303] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:17 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1539 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-20d1c912-389e-46c5-9201-458c50287bd6 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad5000>, body: {"keypair": {"name": "tempest-keypair-398543526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx91rMnsTousi/RzcIs7WSuNy8SIlUbd0n8QdqxmvzsMWmFqZC1QKNDIKh6iZfB4IqUjyYnM5V5ZPibUpyPh626rB/rb/jcuQxNGMpgbmvAFBBJI0aSDRx2aCmiLD8WzQ=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:22 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-20d1c912-389e-46c5-9201-458c50287bd6 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting quotas for project 8a2edca40d96494b8530f49a89dbd6e6. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:50:22 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-20d1c912-389e-46c5-9201-458c50287bd6 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting quotas for user 331c3fa2628d466c9ae2729e269a5332 and project 8a2edca40d96494b8530f49a89dbd6e6. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:50:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-20d1c912-389e-46c5-9201-458c50287bd6 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.054521 Apr 13 21:50:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 103/304] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 21:50:22 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:50:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1170693670", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "b84d8f07-7c73-4678-b29a-132f1a373d9a"}, {"port": "5f66c487-d522-409e-b066-9b0ae3da1bcb", "tag": "port-1"}, {"port": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac", "tag": "port-2"}, {"uuid": "e22c6f13-fe63-4ee1-9103-03c29ab563df", "tag": "net-1"}, {"uuid": "e22c6f13-fe63-4ee1-9103-03c29ab563df"}, {"uuid": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d1a760f7-e484-4699-85e9-3e88a9e4b7aa", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "366d4c6a-2de6-4848-8c15-d7cd841bafd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "8c3610f8-edc3-44d8-8282-e0da72d4ef12", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e0989634-7097-4ab3-9e8a-4d49e6953fb3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--571871577"}], "key_name": "tempest-keypair-398543526", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:23 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] validate_networks() for [('b84d8f07-7c73-4678-b29a-132f1a373d9a', None, None, None, None, None), (None, None, '5f66c487-d522-409e-b066-9b0ae3da1bcb', None, None, None), (None, None, '0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac', None, None, None), ('e22c6f13-fe63-4ee1-9103-03c29ab563df', None, None, None, None, None), ('e22c6f13-fe63-4ee1-9103-03c29ab563df', None, None, None, None, None), ('d1a760f7-e484-4699-85e9-3e88a9e4b7aa', '10.2.2.100', None, None, None, None), ('d1a760f7-e484-4699-85e9-3e88a9e4b7aa', '10.2.2.200', None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting quotas for project 8a2edca40d96494b8530f49a89dbd6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Getting quotas for user 331c3fa2628d466c9ae2729e269a5332 and project 8a2edca40d96494b8530f49a89dbd6e6. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:50:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='366d4c6a-2de6-4848-8c15-d7cd841bafd6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='8c3610f8-edc3-44d8-8282-e0da72d4ef12',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0989634-7097-4ab3-9e8a-4d49e6953fb3',volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:50:26 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-34bc5f1c-42b0-401d-93e1-96463bab8a26 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.42 time: 2.400274 Apr 13 21:50:26 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 103/305] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 21:50:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:50:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:26 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:26 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3eadb5a9-5ce4-477f-b3cb-3fa7f26c7deb tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 200 len: 1279 microversion: 2.42 time: 0.080977 Apr 13 21:50:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 100/306] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:50:26 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8f0b80d1-a98b-41c7-bca0-e5b84d5c0b45"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] HTTP exception thrown: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Request method failure captured: Apr 13 21:50:27 user devstack@n-api.service[61664]: request: PUT /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413/os-volume_attachments/1e50861d-102a-477c-8c66-9d3ed29c7c29 HTTP/1.1 Apr 13 21:50:27 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:50:27 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:50:27 user devstack@n-api.service[61664]: Connection: close Apr 13 21:50:27 user devstack@n-api.service[61664]: Content-Length: 74 Apr 13 21:50:27 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:50:27 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:50:27 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:50:27 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHf_kcwKvwdLxdRCW-iFSvrb5FEvwSMF0pneyzwZbPU8SBYh6aIEjomrYL-wdtP8Sn22IyS-R85EXVNvjwQ17hBpPgP1WWs2WfovVlVu2mf2EdRgrR6lgFQBSXBOx_XQSyej2d3m_ZmsNEdJ8DeMxY72_Dsk5dCsrQeL22ZskJPWoMw Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Project-Id: 33ce178f7e7c41a3a56a745c7a0695b0 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Role: reader,admin,member Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Roles: reader,admin,member Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33ce178f7e7c41a3a56a745c7a0695b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Tenant-Id: 33ce178f7e7c41a3a56a745c7a0695b0 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-596135765 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-User: tempest-VolumesAdminNegativeTest-596135765-project-admin Apr 13 21:50:27 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:50:27 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:50:27 user devstack@n-api.service[61664]: X-User-Id: 1ab670d2dfa84fa68a9421c36206e8e6 Apr 13 21:50:27 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesAdminNegativeTest-596135765-project-admin Apr 13 21:50:27 user devstack@n-api.service[61664]: Apr 13 21:50:27 user devstack@n-api.service[61664]: {"volumeAttachment": {"volumeId": "8f0b80d1-a98b-41c7-bca0-e5b84d5c0b45"}} Apr 13 21:50:27 user devstack@n-api.service[61664]: method: > Apr 13 21:50:27 user devstack@n-api.service[61664]: exception: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. Apr 13 21:50:27 user devstack@n-api.service[61664]: action_args: {'server_id': 'a631dfd9-935a-444d-9b8e-082345fd4413', 'id': '1e50861d-102a-477c-8c66-9d3ed29c7c29', 'body': {'volumeAttachment': {'volumeId': '8f0b80d1-a98b-41c7-bca0-e5b84d5c0b45'}}} Apr 13 21:50:27 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. (HTTP 404) (Request-ID: req-7c5b5455-30fe-4081-9f32-a5106acb6658) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. Apr 13 21:50:27 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:50:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] Returning 404 to user: Volume 1e50861d-102a-477c-8c66-9d3ed29c7c29 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:50:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-35d62e06-f439-405e-b8fa-287af5b4c5a0 tempest-VolumesAdminNegativeTest-596135765 tempest-VolumesAdminNegativeTest-596135765-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413/os-volume_attachments/1e50861d-102a-477c-8c66-9d3ed29c7c29" status: 404 len: 109 microversion: 2.1 time: 0.084118 Apr 13 21:50:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 104/307] 10.0.0.210 () {64 vars in 1510 bytes} [Thu Apr 13 21:50:27 2023] PUT /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413/os-volume_attachments/1e50861d-102a-477c-8c66-9d3ed29c7c29 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:50:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-341b25e3-3d48-4ca9-be33-61cfdf7871a2 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413" status: 204 len: 0 microversion: 2.1 time: 0.195882 Apr 13 21:50:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:50:30 2023] DELETE /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:31 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c93c6f93-5827-425f-94f5-18ac674c7636 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413" status: 200 len: 1502 microversion: 2.1 time: 0.462111 Apr 13 21:50:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 101/309] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:31 2023] GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "name": "network-vif-unplugged", "status": "completed", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] Creating event network-vif-unplugged:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:50:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1d68f105-18b1-4934-9da1-675891e48263 req-49029310-e679-44ef-ae7c-e1ad514f8cc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139220 Apr 13 21:50:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 105/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "name": "network-vif-plugged", "status": "completed", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}, {"server_uuid": "a631dfd9-935a-444d-9b8e-082345fd4413", "name": "network-vif-deleted", "tag": "75e0cbd0-5c75-400a-94e3-4cf30eea2093"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Creating event network-vif-plugged:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:50:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] Creating event network-vif-deleted:75e0cbd0-5c75-400a-94e3-4cf30eea2093 for instance a631dfd9-935a-444d-9b8e-082345fd4413 on user Apr 13 21:50:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0594b72b-a160-4525-ae68-0434f8550e74 req-994a9ec6-559c-4a25-9edb-4ae3900c1b72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046186 Apr 13 21:50:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 105/311] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}, {"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "5f66c487-d522-409e-b066-9b0ae3da1bcb"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Creating event network-changed:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] Creating event network-changed:5f66c487-d522-409e-b066-9b0ae3da1bcb for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9fa46c6f-f225-4471-8df5-00821e8e6927 req-e4bbbeb5-499e-489a-96fb-6de4f0a7ae13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041953 Apr 13 21:50:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 102/312] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c6c3bfdb-f4da-476e-beb0-d27bdd6be377 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c94c670>, body: {"keypair": {"name": "tempest-keypair-113663637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRuooaKJg6vRLlOK02xg8zKdYT3Y5UBvttjIJXXZAePVuuec0h0uLpaZ9ctULaXexX5tgev6Q9EOuUG3Vl0eofb7i7bJLmkvL6JDz6/6SdX7ZlAwcpeutL6uSPDnzXDew=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-c6c3bfdb-f4da-476e-beb0-d27bdd6be377 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting quotas for project 1f969510e1734ad4bf48a8c0a3d7ae8f. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:50:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-c6c3bfdb-f4da-476e-beb0-d27bdd6be377 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting quotas for user 2446d7b79d7f4879ab857ab6a10777aa and project 1f969510e1734ad4bf48a8c0a3d7ae8f. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:50:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c6c3bfdb-f4da-476e-beb0-d27bdd6be377 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.050869 Apr 13 21:50:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 106/313] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 21:50:36 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:50:38 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:38 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:38 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-535284063", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "912df412-2f07-4668-8db3-bbcfced5fb5f"}, {"port": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89", "tag": "port-1"}, {"port": "7062c9f1-5719-4d6b-8b6a-efbb377c078b", "tag": "port-2"}, {"uuid": "50ae5f56-7e00-4798-80bb-bf7a925e1f39", "tag": "net-1"}, {"uuid": "50ae5f56-7e00-4798-80bb-bf7a925e1f39"}, {"uuid": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b0bd1140-dadc-4c14-940a-3b35313e6e52", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fb5cba55-94c2-4da0-9227-07704d15f763", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "47d1ab68-19d7-42ea-95eb-ce2536260227", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "915905d4-b167-4222-8664-66f1072c4d4d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1646929339"}], "key_name": "tempest-keypair-113663637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:38 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac"}, {"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Creating event network-changed:0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] Creating event network-changed:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a0a5ed8a-6aed-4de3-87a3-e4f496087abc req-87128c81-8fab-4a93-873a-1d0f292eeb7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038429 Apr 13 21:50:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 103/314] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:38 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:38 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] validate_networks() for [('912df412-2f07-4668-8db3-bbcfced5fb5f', None, None, None, None, None), (None, None, '079a7af6-43b0-4f03-a24a-b54d0e9a1c89', None, None, None), (None, None, '7062c9f1-5719-4d6b-8b6a-efbb377c078b', None, None, None), ('50ae5f56-7e00-4798-80bb-bf7a925e1f39', None, None, None, None, None), ('50ae5f56-7e00-4798-80bb-bf7a925e1f39', None, None, None, None, None), ('b0bd1140-dadc-4c14-940a-3b35313e6e52', '10.2.2.100', None, None, None, None), ('b0bd1140-dadc-4c14-940a-3b35313e6e52', '10.2.2.200', None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] Creating event network-changed:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d6037877-1d42-47ec-a4e2-c60099b79e03 req-ccc03ff5-375f-4dac-b23e-f8742dc8434f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036105 Apr 13 21:50:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1527581578"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:40 user devstack@n-api.service[61663]: INFO nova.network.security_group_api [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Removing security group c30dc64d-6bc4-4dc8-acce-de46f39edad9 from port a6dc784b-1fab-4f4b-8e84-8df1f191b373 Apr 13 21:50:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a797578e-1c77-4e10-b3d2-21b7bfac4160 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action" status: 202 len: 0 microversion: 2.1 time: 0.642187 Apr 13 21:50:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 104/316] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:50:40 2023] POST /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] Creating event network-changed:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:50:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7b31d357-8d6e-4334-b6df-aec0cb1733c2 req-f010d5b6-4da2-45dd-aea8-d17691447651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045678 Apr 13 21:50:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 108/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5ad95527-bfc1-46ac-8e23-1268d3283eda tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1889572621", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "adff2f70-e396-44d2-a019-46d3611f0b88", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-5ad95527-bfc1-46ac-8e23-1268d3283eda tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] HTTP exception thrown: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. Apr 13 21:50:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5ad95527-bfc1-46ac-8e23-1268d3283eda tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:50:41 user devstack@n-api.service[61663]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 21:50:41 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:50:41 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:50:41 user devstack@n-api.service[61663]: Connection: close Apr 13 21:50:41 user devstack@n-api.service[61663]: Content-Length: 357 Apr 13 21:50:41 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:50:41 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:50:41 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:50:41 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:50:41 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:50:41 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:50:41 user devstack@n-api.service[61663]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:50:41 user devstack@n-api.service[61663]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:50:41 user devstack@n-api.service[61663]: Apr 13 21:50:41 user devstack@n-api.service[61663]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1889572621", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "adff2f70-e396-44d2-a019-46d3611f0b88", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} Apr 13 21:50:41 user devstack@n-api.service[61663]: method: > Apr 13 21:50:41 user devstack@n-api.service[61663]: exception: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. Apr 13 21:50:41 user devstack@n-api.service[61663]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1889572621', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'adff2f70-e396-44d2-a019-46d3611f0b88'}], 'networks': [{'uuid': 'ed9169cc-af6d-4d31-9b2e-9016c5f963c4'}]}}} Apr 13 21:50:41 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. Apr 13 21:50:41 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:50:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5ad95527-bfc1-46ac-8e23-1268d3283eda tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 400 to user: Block Device adff2f70-e396-44d2-a019-46d3611f0b88 is not bootable. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:50:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5ad95527-bfc1-46ac-8e23-1268d3283eda tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.067914 Apr 13 21:50:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 105/318] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:50:41 2023] POST /compute/v2.1/servers => generated 110 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:41 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-82e337e7-54a0-4fbb-8ea1-bcaf0472eaf0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1493 microversion: 2.1 time: 0.178241 Apr 13 21:50:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 109/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:41 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] Creating event network-changed:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-aabe7414-b86d-4ea9-8870-f5f4b82a3f14 req-04c4bd31-0030-463d-a2c3-35f16b07b0e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029872 Apr 13 21:50:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 110/320] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:42 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'services' on Instance uuid fe05a421-ee64-492b-a338-0e864458908c {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:50:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f219cd3c-5715-4df1-b5a9-a0f38a5dac7d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments/58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" status: 202 len: 0 microversion: 2.1 time: 0.274266 Apr 13 21:50:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 106/321] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:50:42 2023] DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments/58713f9a-6c26-4fe7-a2bc-967c96ddcc4c => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7cdd979a-092f-4bf8-b1f5-65b160250020 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064405 Apr 13 21:50:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 111/322] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:50:42 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] Creating event network-changed:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:50:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a760cc3d-19eb-45fe-8804-842244b6de9d req-c2ab25b6-f6fd-445b-ab35-7fcdef171b96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051111 Apr 13 21:50:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 107/323] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting quotas for project 1f969510e1734ad4bf48a8c0a3d7ae8f. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Getting quotas for user 2446d7b79d7f4879ab857ab6a10777aa and project 1f969510e1734ad4bf48a8c0a3d7ae8f. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:50:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fb5cba55-94c2-4da0-9227-07704d15f763',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='47d1ab68-19d7-42ea-95eb-ce2536260227',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='915905d4-b167-4222-8664-66f1072c4d4d',volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:50:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-27aa7764-1cf3-416d-be56-1faf68b2e403 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 5.733779 Apr 13 21:50:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 106/324] 10.0.0.210 () {66 vars in 1266 bytes} [Thu Apr 13 21:50:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 5735 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:50:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9feecc95-b72e-4cb0-a5c4-5c2feef7e2e2 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 200 len: 1278 microversion: 2.32 time: 0.091297 Apr 13 21:50:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 112/325] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:50:43 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:50:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] Creating event network-changed:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-6d27000a-e883-4668-a167-3fb6d5efc6f1 req-66a08bda-3562-4d35-a363-8a13dcb6f0b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038502 Apr 13 21:50:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 108/326] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:44 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6a31e5f0-4f58-430b-ad2d-52b75ca40319 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1489 microversion: 2.1 time: 0.320990 Apr 13 21:50:44 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 107/327] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:44 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1489 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] Creating event network-changed:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-962e4379-eec2-4274-8837-24e6ccdebd2f req-52637a3d-15cd-40cf-9ca2-024021036f3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032006 Apr 13 21:50:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 113/328] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "7062c9f1-5719-4d6b-8b6a-efbb377c078b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=25 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] Creating event network-changed:7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-0ea3a6ac-6abd-422c-a508-5117acba925a req-33371db9-4a15-46d9-9e49-22b9f555767b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055162 Apr 13 21:50:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 109/329] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:51 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] Creating event network-changed:079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-b812f593-9ae5-4496-b460-0fb5bbe84db4 req-358f554f-5137-4b6c-8b9b-dfb1a97c2af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052976 Apr 13 21:50:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 108/330] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] Creating event network-vif-plugged:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f2da930d-9d07-4d39-8d44-905854cdecb4 req-6fa0777e-0a0b-4979-8181-cdb6e2a332fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113284 Apr 13 21:50:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 114/331] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}, {"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Creating event network-changed:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] Creating event network-changed:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-316aeea4-20cf-44ab-96b5-53104f706f2e req-5ce619bf-58d1-4b82-a7cd-228f14c93501 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033498 Apr 13 21:50:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 110/332] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5f66c487-d522-409e-b066-9b0ae3da1bcb"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5f66c487-d522-409e-b066-9b0ae3da1bcb"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Creating event network-vif-plugged:5f66c487-d522-409e-b066-9b0ae3da1bcb for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Creating event network-vif-plugged:5f66c487-d522-409e-b066-9b0ae3da1bcb for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Creating event network-vif-plugged:0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Creating event network-vif-plugged:0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] Creating event network-vif-plugged:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0822db78-4f6b-4870-a160-cf992150a290 req-79f7de1f-7afb-4a69-82a3-8577e340c24e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.090372 Apr 13 21:50:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 109/333] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:53 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:54 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Creating event network-vif-plugged:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] Creating event network-vif-plugged:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-bbefa8d9-beba-4582-8765-a71de08bf232 req-3e54c78d-239f-4af9-a898-aefd586bb849 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039239 Apr 13 21:50:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 115/334] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1093546533"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a8d46f0d-8b19-4edd-b43b-e510aa987f5d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments/a325d973-036d-409b-af0a-cae00a2d5474" status: 200 len: 194 microversion: 2.20 time: 0.142934 Apr 13 21:50:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 110/335] 10.0.0.210 () {64 vars in 1531 bytes} [Thu Apr 13 21:50:54 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments/a325d973-036d-409b-af0a-cae00a2d5474 => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'services' on Instance uuid eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ae0707ad-8abf-4590-a8b7-1edaa4e744c3 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments/a325d973-036d-409b-af0a-cae00a2d5474" status: 202 len: 0 microversion: 2.20 time: 0.184100 Apr 13 21:50:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 116/336] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 21:50:55 2023] DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments/a325d973-036d-409b-af0a-cae00a2d5474 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}, {"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3c82b9ac-919c-4827-b9dc-c7f237357513 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Apr 13 21:50:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 111/337] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 21:50:55 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Creating event network-changed:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Creating event network-vif-plugged:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Creating event network-vif-plugged:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] Creating event network-changed:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6ce72c2f-7a0f-4b45-89d2-80fbc850c23e req-0c0ed50c-7869-47bc-8c74-9835a7faa8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.037631 Apr 13 21:50:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 117/338] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-cf31f987-e5f8-4004-862e-c7d534c7fb0f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/action" status: 202 len: 52 microversion: 2.87 time: 1.011172 Apr 13 21:50:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 111/339] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:50:54 2023] POST /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee/action => generated 52 bytes in 1013 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Creating event network-vif-plugged:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Creating event network-vif-plugged:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] Creating event network-vif-plugged:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c315166d-a4e0-4d9a-95d0-0ebbe4e2e117 req-a4659e16-2746-44b6-8922-95579175b942 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.030675 Apr 13 21:50:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 118/340] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:55 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:55 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'services' on Instance uuid ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:50:55 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-19842bf3-e718-404d-9428-a3dd39d9f73a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments/5c84a9a6-d73f-46ba-b157-ba2642a6a5ae" status: 202 len: 0 microversion: 2.1 time: 0.280012 Apr 13 21:50:55 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:50:55 2023] DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments/5c84a9a6-d73f-46ba-b157-ba2642a6a5ae => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:50:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] Creating event network-vif-plugged:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:50:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a6ae854f-828c-4a85-8a1b-b35d68b1f4b7 req-5f824bc7-f785-4675-beaa-edee2ade554c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029092 Apr 13 21:50:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 112/342] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:50:58 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Going to try to stop instance {{(pid=61664) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 13 21:50:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b97a6da1-0643-4268-a7d9-322f0b49aafd tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action" status: 202 len: 0 microversion: 2.1 time: 0.125383 Apr 13 21:50:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 119/343] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:50:58 2023] POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:58 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:50:58 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f80fd89c-f7fe-45dd-a923-0ab80ffa4051 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1662 microversion: 2.1 time: 0.633800 Apr 13 21:50:58 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 113/344] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:50:58 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1662 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:50:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-unplugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:50:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:50:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:50:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:50:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] Creating event network-vif-unplugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:50:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7c0a3ffe-ff09-4154-9533-ac52698df5a9 req-5709237f-8fd8-4217-a12c-65b3d89866ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032094 Apr 13 21:50:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:50:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:51:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ffc442b8-fed6-48e3-a545-485b978fb84a req-b370b158-710e-44fe-8823-1bf05b94bc7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034775 Apr 13 21:51:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 120/346] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:02 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:02 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:02 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-feecb248-c53c-4bea-bacc-c39e6951fd99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 200 len: 1691 microversion: 2.87 time: 0.210836 Apr 13 21:51:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 114/347] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:51:01 2023] GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:04 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7b351bfa-8cdb-4b5e-870a-a0fdf2050d0f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action" status: 202 len: 0 microversion: 2.1 time: 0.239588 Apr 13 21:51:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 114/348] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:51:04 2023] POST /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ec30c697-83e5-4d08-bd31-cadd129b33ee tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.107739 Apr 13 21:51:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 121/349] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:51:04 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-interface => generated 283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:05 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] Creating event network-changed:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c0717705-44a6-495a-a41f-3b83233c39af req-05c10357-a7bb-498c-884a-3431caff6904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111617 Apr 13 21:51:05 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 115/350] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] Creating event network-vif-unplugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-696e5e80-d6de-4bde-a1c3-edc741f16400 req-38517703-34c2-45f7-872d-979654584e5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031547 Apr 13 21:51:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 115/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:07 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-544b4974-8c4c-4d76-908a-2e6595469a55 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1658 microversion: 2.1 time: 0.136781 Apr 13 21:51:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 122/352] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:07 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1658 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:07 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a8ab415d-ba2f-4983-b6ec-e77c5f113484 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1658 microversion: 2.1 time: 0.170694 Apr 13 21:51:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 116/353] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:07 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1658 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] Creating event network-changed:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-704d7622-0aae-4361-aef2-964897540c13 req-b07adbd6-a119-44c4-8eef-53f61118f047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029111 Apr 13 21:51:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b76fb706-45e8-48a2-83cf-ab57eb2aeddc req-5da93c69-1bc2-4b8c-a4bf-a3b439f8b853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028151 Apr 13 21:51:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 123/355] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] Creating event network-vif-plugged:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-670203b4-64f0-4a99-b5e0-c9d7ba67a97a req-f4af802a-7596-494d-aea3-9daa4c635ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040667 Apr 13 21:51:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 117/356] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}, {"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:51:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-00f5f7ab-0589-4a4e-ac2a-254b07435c4d req-31cb4e71-1c2c-49a9-a085-c532ffb0f029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042802 Apr 13 21:51:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:51:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] Creating event network-vif-plugged:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-06bcc9e7-4179-4644-858d-8bdf74334d76 req-b42f69ca-b99f-444e-9fb6-e68fa9384354 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040040 Apr 13 21:51:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 124/358] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "7062c9f1-5719-4d6b-8b6a-efbb377c078b"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "7062c9f1-5719-4d6b-8b6a-efbb377c078b"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] Creating event network-vif-plugged:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-a314ed36-d002-4ed4-89ad-8574f2def2f0 req-157f4745-d0e7-4c65-8ce9-163cb1bfdb1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1380 microversion: 2.1 time: 0.048994 Apr 13 21:51:12 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 118/359] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 21:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 1380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] Creating event network-vif-plugged:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-313bbebf-9c8e-43ba-9757-fc05a04a39cc req-adbe9721-e140-4da3-86ea-dd93609687dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 Apr 13 21:51:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 118/360] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:14 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:14 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Creating event network-vif-plugged:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Creating event network-vif-plugged:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] Creating event network-vif-plugged:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:51:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f31bc3c6-fad1-4c13-9f02-cef68eaa8272 req-993eca9f-ddef-4638-8aed-d53fe7a759b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041480 Apr 13 21:51:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 125/361] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f7358da2-e14f-4544-a663-026a097fd93b tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 200 len: 2826 microversion: 2.42 time: 0.195374 Apr 13 21:51:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 119/362] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:51:16 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 2826 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: a631dfd9-935a-444d-9b8e-082345fd4413] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=20 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] HTTP exception thrown: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Request method failure captured: Apr 13 21:51:21 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 HTTP/1.1 Apr 13 21:51:21 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:51:21 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:51:21 user devstack@n-api.service[61663]: Connection: close Apr 13 21:51:21 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:51:21 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:51:21 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:51:21 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:51:21 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfqeiGytOJaWCdk6ojMbS8I_5wb9ZfWOYYzMkeXZyVIdBKpSxqYmOvzg1Ci03NIyCg898Y6MIRaHRNiY0ETnHTe54CGl1EAvbSAtEcm8WWNU8Uawn2hc1OOjPhe8XBnOjbo8506JKh4f3Bva9HaQcSWq5UnuOgG9sAgscAmjpKB7Wg Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Project-Id: 03a67a9a0d514f19b6cc0b39477a1b42 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Tenant-Id: 03a67a9a0d514f19b6cc0b39477a1b42 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:51:21 user devstack@n-api.service[61663]: X-User: tempest-VolumesAdminNegativeTest-1461294072-project-member Apr 13 21:51:21 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:51:21 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:51:21 user devstack@n-api.service[61663]: X-User-Id: 97e87956414a49c4b3c34e51fe6ed2ec Apr 13 21:51:21 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesAdminNegativeTest-1461294072-project-member Apr 13 21:51:21 user devstack@n-api.service[61663]: method: > Apr 13 21:51:21 user devstack@n-api.service[61663]: exception: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. Apr 13 21:51:21 user devstack@n-api.service[61663]: action_args: {'id': 'a631dfd9-935a-444d-9b8e-082345fd4413'} Apr 13 21:51:21 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. Apr 13 21:51:21 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:51:21 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Returning 404 to user: Instance a631dfd9-935a-444d-9b8e-082345fd4413 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:51:21 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-394c08e9-e88c-41ea-8a3f-66b9d5d99a8c tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413" status: 404 len: 111 microversion: 2.1 time: 0.143059 Apr 13 21:51:21 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:21 2023] GET /compute/v2.1/servers/a631dfd9-935a-444d-9b8e-082345fd4413 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=25 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:25 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:51:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f0bce22f-2830-4684-a938-ae31e60dad6b tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e" status: 204 len: 0 microversion: 2.1 time: 0.120525 Apr 13 21:51:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 126/364] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:51:25 2023] DELETE /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=26 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:25 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97e87956414a49c4b3c34e51fe6ed2ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03a67a9a0d514f19b6cc0b39477a1b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-03e1238b-c094-48ed-9c2a-271c0af5ed8a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e" status: 200 len: 1670 microversion: 2.1 time: 0.209896 Apr 13 21:51:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 120/365] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:25 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e => generated 1670 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "name": "network-vif-unplugged", "status": "completed", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] Creating event network-vif-unplugged:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:51:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-213cf456-b10a-4237-8acd-981e946ecdd7 req-c5849cee-e3cc-44ce-8507-cd7832513602 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041191 Apr 13 21:51:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "name": "network-vif-deleted", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] Creating event network-vif-deleted:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:51:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-cad3f7f3-7529-433b-983c-f43b2b2e4860 req-ea6bb183-97ea-4843-aacf-f938d9f5cff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050097 Apr 13 21:51:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 127/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be81f393-654b-4b50-856e-00818f3ae59e", "name": "network-vif-plugged", "status": "completed", "tag": "c0b475f1-01a2-4492-ac88-67f44080f771"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] Creating event network-vif-plugged:c0b475f1-01a2-4492-ac88-67f44080f771 for instance be81f393-654b-4b50-856e-00818f3ae59e on user Apr 13 21:51:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-e5f0f0ba-4cdb-4af0-9b06-ed03fa9d80c3 req-e5951bb8-a562-4bab-8a18-8a8e750c0b0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Apr 13 21:51:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 121/368] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7f4bd0ef-4c32-4ba5-a114-0f3a4135d925 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083736 Apr 13 21:51:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:51:32 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HTTP exception thrown: Instance fe05a421-ee64-492b-a338-0e864458908c is not attached to volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Request method failure captured: Apr 13 21:51:32 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments/58713f9a-6c26-4fe7-a2bc-967c96ddcc4c HTTP/1.1 Apr 13 21:51:32 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:51:32 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:51:32 user devstack@n-api.service[61664]: Connection: close Apr 13 21:51:32 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:51:32 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:51:32 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:51:32 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:51:32 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHgynpojptmTe_sI87n3uk0HjCiZ-cPMfqC4MJbZ_WhjJ2nIJB8MwofuVQZz-QSzV13A63aoRSBQMsBlLFOsuxFM1Yw6ovXDFlWQbH8g7Qc4gdSkXQKOBS_CaDDcJ0eIPCSMq9v0fQg4-OjPB1JMXCVupa_I26GoO5ZyHszOn7fwfZU Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Project-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Tenant: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Tenant-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-User: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:51:32 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:51:32 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:51:32 user devstack@n-api.service[61664]: X-User-Id: 710e0446cf794e94b3ab29bb0d7e10d8 Apr 13 21:51:32 user devstack@n-api.service[61664]: X-User-Name: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:51:32 user devstack@n-api.service[61664]: method: > Apr 13 21:51:32 user devstack@n-api.service[61664]: exception: Instance fe05a421-ee64-492b-a338-0e864458908c is not attached to volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c Apr 13 21:51:32 user devstack@n-api.service[61664]: action_args: {'server_id': 'fe05a421-ee64-492b-a338-0e864458908c', 'id': '58713f9a-6c26-4fe7-a2bc-967c96ddcc4c'} Apr 13 21:51:32 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c. Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe05a421-ee64-492b-a338-0e864458908c is not attached to volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe05a421-ee64-492b-a338-0e864458908c is not attached to volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c Apr 13 21:51:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:51:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Returning 404 to user: Instance fe05a421-ee64-492b-a338-0e864458908c is not attached to volume 58713f9a-6c26-4fe7-a2bc-967c96ddcc4c {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:51:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4e0a2d25-4088-40e3-9881-7a3d460d95d8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments/58713f9a-6c26-4fe7-a2bc-967c96ddcc4c" status: 404 len: 154 microversion: 2.1 time: 0.137145 Apr 13 21:51:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 128/370] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:51:32 2023] DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c/os-volume_attachments/58713f9a-6c26-4fe7-a2bc-967c96ddcc4c => generated 154 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-38366b92-46de-4caa-98f5-018a7bb5f6a7 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 200 len: 2823 microversion: 2.32 time: 0.211774 Apr 13 21:51:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 122/371] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:51:33 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 2823 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:51:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:51:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4535717c-bfdf-4426-89cb-d8c88e9d0365 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 204 len: 0 microversion: 2.1 time: 0.136587 Apr 13 21:51:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 122/372] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:51:36 2023] DELETE /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:36 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-68b19ba9-235a-4a92-a015-3d68b90d2d17 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 200 len: 1543 microversion: 2.1 time: 0.164551 Apr 13 21:51:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 129/373] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:36 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:51:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-unplugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] Creating event network-vif-unplugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:51:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-dcf91d0d-f106-406d-ab39-7fc31ada5a36 req-dd0cfbb8-2da5-44fa-9965-7c4481df232b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030048 Apr 13 21:51:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 123/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:37 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lazy-loading 'services' on Instance uuid af4efbd5-a4c1-4e7c-b274-92413f86f2a8 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:51:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-000fcf50-2167-4f24-b871-6773e714bad4 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments/5b928772-e4f8-489b-93b3-282f3c7c184b" status: 202 len: 0 microversion: 2.1 time: 0.227167 Apr 13 21:51:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:51:37 2023] DELETE /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments/5b928772-e4f8-489b-93b3-282f3c7c184b => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-deleted", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ff211e42-fd0f-4af5-8127-d24c9cd846a1 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057153 Apr 13 21:51:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 130/376] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:51:37 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] Creating event network-vif-deleted:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:51:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-8c755e67-cc88-420f-8405-ad4566948678 req-2076a062-7fe5-420b-9a8e-292505494bd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032944 Apr 13 21:51:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 124/377] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe05a421-ee64-492b-a338-0e864458908c", "name": "network-vif-plugged", "status": "completed", "tag": "a6dc784b-1fab-4f4b-8e84-8df1f191b373"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] Creating event network-vif-plugged:a6dc784b-1fab-4f4b-8e84-8df1f191b373 for instance fe05a421-ee64-492b-a338-0e864458908c on user Apr 13 21:51:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-af22d0b2-7972-4e7e-8ca3-58a4c3374a74 req-15d941e1-de72-4459-aab7-e0b09dc56b5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031897 Apr 13 21:51:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:42 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3fd79f4d-49b7-4161-98b1-42fbbe31df43 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1493 microversion: 2.1 time: 0.149330 Apr 13 21:51:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 131/379] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:42 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1493 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eed57ed-bdac-494d-97ac-b04f3928024e"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HTTP exception thrown: Cannot 'attach_volume' instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de while it is in vm_state rescued Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Request method failure captured: Apr 13 21:51:45 user devstack@n-api.service[61665]: request: POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/os-volume_attachments HTTP/1.1 Apr 13 21:51:45 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:51:45 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:51:45 user devstack@n-api.service[61665]: Connection: close Apr 13 21:51:45 user devstack@n-api.service[61665]: Content-Length: 74 Apr 13 21:51:45 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:51:45 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:51:45 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:51:45 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfgINELovSYm__2wxLA9vmb6F19FIFzyHnsB8GCT5zmExK61RxLrWwm71efToqXOq8QYwameGwiiiBIMKv_GuEGgjCT49EWNFTanBBgJi9AWgBRw97_RIogVE9SaXGT6a2lMum3vUzYMiCPuLWMNfHmXWAQPO77p_Iul6EqMk65Hi8 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Project-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70e84a09a76a44eb830e575db4321224"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Tenant-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-User: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 21:51:45 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:51:45 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:51:45 user devstack@n-api.service[61665]: X-User-Id: e77459bc3fa8496da1a089c460e32ed2 Apr 13 21:51:45 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 21:51:45 user devstack@n-api.service[61665]: Apr 13 21:51:45 user devstack@n-api.service[61665]: {"volumeAttachment": {"volumeId": "5eed57ed-bdac-494d-97ac-b04f3928024e"}} Apr 13 21:51:45 user devstack@n-api.service[61665]: method: > Apr 13 21:51:45 user devstack@n-api.service[61665]: exception: Cannot 'attach_volume' instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de while it is in vm_state rescued Apr 13 21:51:45 user devstack@n-api.service[61665]: action_args: {'server_id': 'f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de', 'body': {'volumeAttachment': {'volumeId': '5eed57ed-bdac-494d-97ac-b04f3928024e'}}} Apr 13 21:51:45 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de while it is in vm_state rescued Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de while it is in vm_state rescued Apr 13 21:51:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Returning 409 to user: Cannot 'attach_volume' instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de while it is in vm_state rescued {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:51:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f00ba1a3-d3dc-4c01-8b61-2684ab7e6b73 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042871 Apr 13 21:51:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 125/380] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:51:45 2023] POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b54eb3a4-943e-4ee9-bd82-557d05ade2c8 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/action" status: 202 len: 0 microversion: 2.1 time: 0.079579 Apr 13 21:51:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 125/381] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:51:45 2023] POST /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-28919c17-7685-4bc2-9923-de1668739987 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1497 microversion: 2.1 time: 0.150021 Apr 13 21:51:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 132/382] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:45 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-fd62a0d6-b1c9-4dbb-8997-a0defe311ea4 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045752 Apr 13 21:51:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 126/383] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 21:51:45 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:51:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1aa611bb-7183-4791-b641-2cde092ed5fb tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 204 len: 0 microversion: 2.20 time: 0.106939 Apr 13 21:51:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 126/384] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:51:45 2023] DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:45 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f2990786-35ec-441d-a17c-236723ed94d9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 200 len: 1709 microversion: 2.20 time: 0.157303 Apr 13 21:51:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 133/385] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:51:45 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:51:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-unplugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] Creating event network-vif-unplugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:51:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-7fc81fb6-edf3-4c1f-9ca9-876f8d91729a req-b11eba14-dde2-40a5-9fce-390985d30c8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027322 Apr 13 21:51:46 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 127/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] Creating event network-vif-unplugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:51:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7d4d822e-d9f3-4c34-8e30-364ebaf29655 req-01ed8d15-651a-4ae0-89f7-c4c9c946f4a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028604 Apr 13 21:51:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 127/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:48 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-plugged", "status": "completed", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}, {"server_uuid": "eaff33f4-c1f5-45c5-b54f-555d1c66e8c7", "name": "network-vif-deleted", "tag": "e918ab8f-9fcd-47df-974d-eb6568414011"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:48 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Creating event network-vif-plugged:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:51:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] Creating event network-vif-deleted:e918ab8f-9fcd-47df-974d-eb6568414011 for instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 on user Apr 13 21:51:48 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-bbd25ce1-f489-43f3-852a-47194469347f req-886c1aeb-d612-4df8-9c2b-2e139fc69acc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034403 Apr 13 21:51:48 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 134/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:51:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-7fd4f22f-9e83-47f6-b85b-06040931d78c req-ee1d3d2f-0c5c-4e9d-86ab-69141dde889b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 Apr 13 21:51:48 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 128/389] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:49 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:51:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f2ad62ea-f52b-4d3b-b00d-97e079fa2033 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1639 microversion: 2.1 time: 0.164094 Apr 13 21:51:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:51:48 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1639 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:51:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}, {"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:51:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:51:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:51:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:51:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:51:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 21:51:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-6b99a248-59a7-4b75-8a6d-ba5e5de6b19a req-5a99881d-d29d-4316-80cf-b54eac9d45d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033427 Apr 13 21:51:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 135/391] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=17 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=31 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1476604230", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "5f022439-52f7-4c06-a4f9-6943fddcd352"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] validate_networks() for [('5f022439-52f7-4c06-a4f9-6943fddcd352', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for user 0ab740920cac4befac62a72f7ce5a817 and project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:52:02 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:52:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e928c053-4ef8-43fa-9357-01a19750ff93 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.488241 Apr 13 21:52:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 129/392] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:52:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:02 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c9a6730b-6fef-4323-9bd0-e4216a7c9560 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1395 microversion: 2.87 time: 0.084317 Apr 13 21:52:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 129/393] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:02 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1395 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:05 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] Creating event network-changed:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:52:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7f783312-5ad6-4c01-8a01-fb6ca9253639 req-684199b6-d4da-4e01-a872-a1463f5c05b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041626 Apr 13 21:52:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 136/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:10 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-04009194-324c-4bf0-9b77-c852228f626e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1658 microversion: 2.1 time: 0.146344 Apr 13 21:52:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 130/395] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:10 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c038cb0-7b1c-4305-97d8-318974560720"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-52ced5e5-18fb-4763-9638-04304b1c0138 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299216 Apr 13 21:52:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 130/396] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:52:10 2023] POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] [instance: be81f393-654b-4b50-856e-00818f3ae59e] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] HTTP exception thrown: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Request method failure captured: Apr 13 21:52:15 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e HTTP/1.1 Apr 13 21:52:15 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:52:15 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:52:15 user devstack@n-api.service[61664]: Connection: close Apr 13 21:52:15 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:52:15 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:52:15 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:52:15 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:52:15 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfqeiGytOJaWCdk6ojMbS8I_5wb9ZfWOYYzMkeXZyVIdBKpSxqYmOvzg1Ci03NIyCg898Y6MIRaHRNiY0ETnHTe54CGl1EAvbSAtEcm8WWNU8Uawn2hc1OOjPhe8XBnOjbo8506JKh4f3Bva9HaQcSWq5UnuOgG9sAgscAmjpKB7Wg Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Project-Id: 03a67a9a0d514f19b6cc0b39477a1b42 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a67a9a0d514f19b6cc0b39477a1b42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Tenant-Id: 03a67a9a0d514f19b6cc0b39477a1b42 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1461294072 Apr 13 21:52:15 user devstack@n-api.service[61664]: X-User: tempest-VolumesAdminNegativeTest-1461294072-project-member Apr 13 21:52:15 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:52:15 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:52:15 user devstack@n-api.service[61664]: X-User-Id: 97e87956414a49c4b3c34e51fe6ed2ec Apr 13 21:52:15 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesAdminNegativeTest-1461294072-project-member Apr 13 21:52:15 user devstack@n-api.service[61664]: method: > Apr 13 21:52:15 user devstack@n-api.service[61664]: exception: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. Apr 13 21:52:15 user devstack@n-api.service[61664]: action_args: {'id': 'be81f393-654b-4b50-856e-00818f3ae59e'} Apr 13 21:52:15 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. Apr 13 21:52:15 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Returning 404 to user: Instance be81f393-654b-4b50-856e-00818f3ae59e could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:52:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2db11c39-0856-4728-a847-aaa319b34d2a tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e" status: 404 len: 111 microversion: 2.1 time: 0.044023 Apr 13 21:52:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 137/397] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:15 2023] GET /compute/v2.1/servers/be81f393-654b-4b50-856e-00818f3ae59e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:52:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8413fb39-8e12-4110-af50-058c0d596859 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] Calling method '.version_select at 0x7f4b3cb249d0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8413fb39-8e12-4110-af50-058c0d596859 tempest-VolumesAdminNegativeTest-1461294072 tempest-VolumesAdminNegativeTest-1461294072-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995468323" status: 202 len: 0 microversion: 2.1 time: 0.028124 Apr 13 21:52:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 131/398] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 21:52:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1995468323 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-531858c2-57ec-4c7d-b911-5429b5078b40 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.127925 Apr 13 21:52:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 131/399] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:52:16 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/os-interface => generated 1830 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:52:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-69acd10e-152d-4085-8d13-777046021769 req-54c8410b-cc5e-4713-9814-97b702e7c5f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028188 Apr 13 21:52:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 138/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9c21c160-2f9b-478a-ac9d-d6694ca901dd tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 200 len: 2826 microversion: 2.42 time: 0.586769 Apr 13 21:52:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 132/401] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:17 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 2826 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c9531145-b41d-422c-9560-f2a648ecb031 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1704 microversion: 2.1 time: 0.219634 Apr 13 21:52:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 132/402] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:18 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1704 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1348347503", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2d7ea24d-30a3-4946-a998-92bbbe9bd28c tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.214069 Apr 13 21:52:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 139/403] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:52:18 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac/os-interface => generated 1830 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: dict_keys(['metadata_items']) {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: dict_keys(['metadata_items']) {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ea10fe43-83dd-41ee-a379-c8d33da596c5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action" status: 202 len: 1160 microversion: 2.1 time: 0.385966 Apr 13 21:52:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 133/404] 10.0.0.210 () {64 vars in 1356 bytes} [Thu Apr 13 21:52:18 2023] POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action => generated 1160 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}, {"name": "network-changed", "server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:52:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] Creating event network-changed:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-77df93c8-0685-4e51-98b7-9091d4aa2eb1 req-2dbd64a6-85b7-4b08-9a8f-acd3dd4ee1ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034119 Apr 13 21:52:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 140/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:19 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e442791f-ba14-4696-b6a3-2bbe2fd8e325 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1733 microversion: 2.1 time: 0.606882 Apr 13 21:52:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 133/406] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:18 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1733 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:19 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:52:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9f727f0d-7c7a-4482-8a0d-7625715152b9 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 204 len: 0 microversion: 2.42 time: 0.377029 Apr 13 21:52:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 134/407] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:52:19 2023] DELETE /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:20 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '331c3fa2628d466c9ae2729e269a5332', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a2edca40d96494b8530f49a89dbd6e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aeda12b9-97c4-4d81-aa76-9833be78edf5 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 200 len: 2950 microversion: 2.42 time: 0.403587 Apr 13 21:52:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 141/408] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:19 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 2950 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] Creating event network-vif-unplugged:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-72ecbd31-8e9a-4ba0-b99c-b2b3bae83da8 req-abe6fe35-59d1-4b70-b8c7-90a9cf449391 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036006 Apr 13 21:52:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 134/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "5f66c487-d522-409e-b066-9b0ae3da1bcb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] Creating event network-vif-unplugged:5f66c487-d522-409e-b066-9b0ae3da1bcb for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-761f0efd-3e69-4d59-ae5b-6fe156d3fbb6 req-217b3236-84b7-4536-b5fd-2f5a80b19bde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040110 Apr 13 21:52:20 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 135/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-unplugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Creating event network-vif-unplugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:52:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:52:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] Creating event network-vif-unplugged:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d83a7361-933b-4898-852b-0c2c4f32ff02 req-48c05610-770b-491d-b1af-1b3ce092c083 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.055398 Apr 13 21:52:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 142/411] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:21 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Creating event network-vif-plugged:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Creating event network-vif-unplugged:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] Creating event network-vif-plugged:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5f66c487-d522-409e-b066-9b0ae3da1bcb"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-unplugged", "status": "completed", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-01ed3110-ff40-462c-bf1a-c5aa20125e8b req-9057177f-139b-4417-8023-7661b07111d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050125 Apr 13 21:52:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 135/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:22 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-plugged:5f66c487-d522-409e-b066-9b0ae3da1bcb for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-unplugged:0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-plugged:0e47caf0-d3c4-4537-b6ef-1c0b2c99f3ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-unplugged:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-plugged:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] Creating event network-vif-unplugged:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-47d87559-3933-44d0-89ae-89af1d443267 req-9335118e-ef91-475f-96e8-d185730355d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.041749 Apr 13 21:52:22 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 136/413] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:22 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:52:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] Creating event network-vif-plugged:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8ccf8007-90a7-424c-8361-954a0e6847ec req-8793d2b1-777d-4cef-b3bd-35da2eba6932 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030234 Apr 13 21:52:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 143/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-plugged", "status": "completed", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] Creating event network-vif-plugged:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-aca1dfe7-b064-44c4-8de3-4f5a4e25fec4 req-d5227b88-e605-4d63-ade3-f78a1c4608a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039382 Apr 13 21:52:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 136/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-deleted", "tag": "6dfbfb87-4182-4cef-b879-4e6cbbe7ed51"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] Creating event network-vif-deleted:6dfbfb87-4182-4cef-b879-4e6cbbe7ed51 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-834643fc-40d9-4879-bc00-e9ef0377b928 req-83236e71-1e9d-4030-9a1a-6ade115dcf9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Apr 13 21:52:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 137/416] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: fe05a421-ee64-492b-a338-0e864458908c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HTTP exception thrown: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Request method failure captured: Apr 13 21:52:26 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c HTTP/1.1 Apr 13 21:52:26 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:52:26 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:52:26 user devstack@n-api.service[61664]: Connection: close Apr 13 21:52:26 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:52:26 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:52:26 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:52:26 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:52:26 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHgynpojptmTe_sI87n3uk0HjCiZ-cPMfqC4MJbZ_WhjJ2nIJB8MwofuVQZz-QSzV13A63aoRSBQMsBlLFOsuxFM1Yw6ovXDFlWQbH8g7Qc4gdSkXQKOBS_CaDDcJ0eIPCSMq9v0fQg4-OjPB1JMXCVupa_I26GoO5ZyHszOn7fwfZU Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Project-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Tenant: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Tenant-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-User: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:52:26 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:52:26 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:52:26 user devstack@n-api.service[61664]: X-User-Id: 710e0446cf794e94b3ab29bb0d7e10d8 Apr 13 21:52:26 user devstack@n-api.service[61664]: X-User-Name: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:52:26 user devstack@n-api.service[61664]: method: > Apr 13 21:52:26 user devstack@n-api.service[61664]: exception: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. Apr 13 21:52:26 user devstack@n-api.service[61664]: action_args: {'id': 'fe05a421-ee64-492b-a338-0e864458908c'} Apr 13 21:52:26 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. Apr 13 21:52:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:52:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Returning 404 to user: Instance fe05a421-ee64-492b-a338-0e864458908c could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:52:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3189e561-82c9-4902-8bbb-b45c941345d2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c" status: 404 len: 111 microversion: 2.1 time: 0.040195 Apr 13 21:52:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 144/417] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:26 2023] GET /compute/v2.1/servers/fe05a421-ee64-492b-a338-0e864458908c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:52:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b1759338-1ea7-4938-b0f9-2ea81f680200 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '.version_select at 0x7f4b3ca59bd0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b1759338-1ea7-4938-b0f9-2ea81f680200 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1695743106" status: 202 len: 0 microversion: 2.1 time: 0.029133 Apr 13 21:52:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 137/418] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 13 21:52:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1695743106 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f3f163cd-42d8-4972-9af4-761f70551b69 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046563 Apr 13 21:52:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-deleted", "tag": "7587c8c4-a480-4db1-be69-2e60fbd6e27b"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-deleted", "tag": "9f031ddd-e857-4075-9b14-e71dd6581d72"}, {"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-deleted", "tag": "5be52063-b3a4-42e7-ba9c-7791634309ac"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 138/419] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:52:27 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:52:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:27 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Creating event network-vif-deleted:7587c8c4-a480-4db1-be69-2e60fbd6e27b for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Creating event network-vif-deleted:9f031ddd-e857-4075-9b14-e71dd6581d72 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] Creating event network-vif-deleted:5be52063-b3a4-42e7-ba9c-7791634309ac for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5569c2af-dd52-4d6e-82b0-4888553e5b29 req-5a3bb500-a8e6-46f1-a31a-b54089ee83cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.049691 Apr 13 21:52:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 145/420] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:27 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:52:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-666aa5dd-8f61-4bb4-a72f-97e9fb26b478 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cb16b00>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-636650613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFchKKqHuC1A8TVFkKSWtfAOCeALfKG5uYpEQTwmP5PX7R4ATfyOZxxZVyd+GOJywfIC+zr0Ar04FqfPo8XD9N72V5J7q/z2PYiROQQ6v4nThfjKvGI9C5bEr2NM1HThiA=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-666aa5dd-8f61-4bb4-a72f-97e9fb26b478 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:29 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-666aa5dd-8f61-4bb4-a72f-97e9fb26b478 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for user 710e0446cf794e94b3ab29bb0d7e10d8 and project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-666aa5dd-8f61-4bb4-a72f-97e9fb26b478 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055803 Apr 13 21:52:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 138/421] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:52:29 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-808147313", "imageRef": "8d241d02-be9d-4e4d-b10c-ab4729e58ff8", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-636650613", "networks": [{"uuid": "7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:29 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] validate_networks() for [('7c6dfe19-b9cb-41e3-b72f-37efafdd4ca2', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:52:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7905fecf-f246-4ed8-a5d4-9abdd3fb9cac", "name": "network-vif-deleted", "tag": "24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] Creating event network-vif-deleted:24b3ada6-d0e0-4fc1-9616-315f3f4a4ef2 for instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac on user Apr 13 21:52:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e866d669-825b-4e5d-9d54-109bac343c8e req-75f0adf1-d2c5-447a-bf31-e0369aa41648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033302 Apr 13 21:52:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 146/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Getting quotas for user 710e0446cf794e94b3ab29bb0d7e10d8 and project 7d4e8c27ff7d4fa9a61e000c9d02c5f4. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:52:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d241d02-be9d-4e4d-b10c-ab4729e58ff8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:52:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-eb555860-8332-44d5-8cf0-8ff6a42be186 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.739031 Apr 13 21:52:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 139/423] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:52:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:52:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-efb966da-5e92-446b-bae6-e07e1cf76b6d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-efb966da-5e92-446b-bae6-e07e1cf76b6d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:30 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-efb966da-5e92-446b-bae6-e07e1cf76b6d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-efb966da-5e92-446b-bae6-e07e1cf76b6d tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1251 microversion: 2.1 time: 0.072939 Apr 13 21:52:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 139/424] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:30 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1251 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2f88a6f3-673c-4905-9e9f-873553e86145 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '.version_select at 0x7f4b3c94f010>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2f88a6f3-673c-4905-9e9f-873553e86145 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02" status: 204 len: 0 microversion: 2.1 time: 0.425480 Apr 13 21:52:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 147/425] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:31 2023] DELETE /compute/v2.1/images/681d671a-5206-4f33-9bd7-d9abc8678d02 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:31 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:52:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-52cf7ce5-8bb6-4b31-b909-57e70bd4471d tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 204 len: 0 microversion: 2.1 time: 0.399905 Apr 13 21:52:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 140/426] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:52:31 2023] DELETE /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:52:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:52:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:52:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-62fd82dc-2e8a-4321-a4ad-5f91825358af req-251c8870-c156-4a8b-9270-6cebbc752c11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050911 Apr 13 21:52:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 140/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:32 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3c1bbf573ea436293abf4debdecc515', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4235a17cc95422dacb6386d4952fc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-964db74e-0875-410e-bf90-f1832aab00fc tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 200 len: 1679 microversion: 2.1 time: 0.320357 Apr 13 21:52:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 148/428] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:31 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 1679 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}, {"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Creating event network-vif-unplugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:52:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] Creating event network-vif-plugged:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:52:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-35631444-1e9e-40d7-ac32-abe36167c2f4 req-cc4737bf-dd30-4384-b75f-6b5ac164cfed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.055633 Apr 13 21:52:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 141/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:34 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4efbd5-a4c1-4e7c-b274-92413f86f2a8", "name": "network-vif-deleted", "tag": "f0a7bc69-be17-49d2-94fc-40541afce8ed"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] Creating event network-vif-deleted:f0a7bc69-be17-49d2-94fc-40541afce8ed for instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 on user Apr 13 21:52:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-32609aed-3fb3-4b64-a174-25dc415126f5 req-e897967f-04f8-4c73-a0ac-4fb1e498a521 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045418 Apr 13 21:52:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 149/430] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7a2c9c37-f2a4-4ec6-896e-f5b9acf956b0 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.193788 Apr 13 21:52:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 141/431] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:52:34 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea/os-interface => generated 1829 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e946c727-e60f-4c38-9f84-12f3f7224d2c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 200 len: 2823 microversion: 2.32 time: 0.233095 Apr 13 21:52:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 142/432] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:35 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 2823 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ed1d04f0-40f6-4614-8975-64d39ec9b84e tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1503 microversion: 2.1 time: 0.166940 Apr 13 21:52:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 150/433] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:35 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7d5995a7-6d32-49f9-a969-44bcfb4cb362 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.137729 Apr 13 21:52:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 142/434] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:52:35 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea/os-interface => generated 1829 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:52:35 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 HTTP/1.1 Apr 13 21:52:35 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:52:35 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:52:35 user devstack@n-api.service[61665]: Connection: close Apr 13 21:52:35 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:52:35 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:52:35 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:52:35 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:52:35 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:52:35 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:52:35 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:52:35 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:52:35 user devstack@n-api.service[61665]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:52:35 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:52:35 user devstack@n-api.service[61665]: method: > Apr 13 21:52:35 user devstack@n-api.service[61665]: exception: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:52:35 user devstack@n-api.service[61665]: action_args: {'id': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7'} Apr 13 21:52:35 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:52:35 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:52:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:52:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-db22eb9d-b466-4b96-99b5-95c8ace3e75e tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 404 len: 111 microversion: 2.20 time: 0.033660 Apr 13 21:52:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 143/435] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:35 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:52:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d7eac97f-d7e5-46e9-aa32-730591f72b10 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '.version_select at 0x7f4b3cad5630>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d7eac97f-d7e5-46e9-aa32-730591f72b10 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819128718" status: 204 len: 0 microversion: 2.20 time: 0.024952 Apr 13 21:52:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 151/436] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 21:52:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819128718 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:52:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] Creating event network-changed:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:52:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-102e58f1-cebd-45ce-9e57-6f3f59293b35 req-3f6ea9b9-93ee-4fd9-9599-e95b0532102b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028936 Apr 13 21:52:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 143/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:52:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] Creating event network-changed:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-a3da7dda-c3f6-4ba0-bd7b-dd073e298276 req-dde314b9-56e6-43ef-9ebd-fa1fb1b74f82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060113 Apr 13 21:52:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 144/438] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:52:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-75900ab4-f3c9-4376-b390-9145b9fc273b tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 204 len: 0 microversion: 2.32 time: 0.208631 Apr 13 21:52:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 152/439] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:52:36 2023] DELETE /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1db080bc-e63b-41a4-955e-3e0b35684220 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cb244c0>, body: {"keypair": {"name": "tempest-keypair-1268128451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXhPPymVnGsGI8iPnkTaRKfPT/rUDm48QkxOPI6ZWHXQz9atCTXJ29rrIJZqJqbdFj0MEal6JqZMkPR7ZgeYnFdlqc8HBwjKnYEiOmGpjFVUDqtFqGBgnihI4QoBsFC8Q=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:37 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1db080bc-e63b-41a4-955e-3e0b35684220 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for project 73c23bc3e8b14441b4622095502b5dae. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:37 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1db080bc-e63b-41a4-955e-3e0b35684220 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for user 3f151b673e3d47acb9c3ed9b9ecaf687 and project 73c23bc3e8b14441b4622095502b5dae. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1db080bc-e63b-41a4-955e-3e0b35684220 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.067173 Apr 13 21:52:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 145/440] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 13 21:52:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:37 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2446d7b79d7f4879ab857ab6a10777aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f969510e1734ad4bf48a8c0a3d7ae8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4333aed2-07cf-4dcd-93b4-c5b1ff252698 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 200 len: 2829 microversion: 2.32 time: 0.380108 Apr 13 21:52:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 144/441] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:37 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 2829 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] Creating event network-vif-unplugged:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-da6fd88a-58fc-4168-84bd-049c8a147f4d req-84446084-e399-4d3a-bf99-8d8d114c848d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060320 Apr 13 21:52:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 153/442] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:38 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:52:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:52:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] Creating event network-vif-unplugged:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-6cd0251d-c6fa-41fe-99ba-140e9006c6ae req-bbd3b920-f714-4cb1-9539-f06b3772b38d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.049284 Apr 13 21:52:38 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 146/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "079a7af6-43b0-4f03-a24a-b54d0e9a1c89"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "7062c9f1-5719-4d6b-8b6a-efbb377c078b"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "7062c9f1-5719-4d6b-8b6a-efbb377c078b"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-plugged:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-unplugged:079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-plugged:079a7af6-43b0-4f03-a24a-b54d0e9a1c89 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-unplugged:7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-plugged:7062c9f1-5719-4d6b-8b6a-efbb377c078b for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-unplugged:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-plugged:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] Creating event network-vif-unplugged:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-398b59a1-c58d-4a76-8456-1a5308f621b4 req-ba576188-86ee-4159-90c1-81d1b392e18e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1388 microversion: 2.1 time: 0.046612 Apr 13 21:52:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 145/444] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 21:52:39 2023] POST /compute/v2.1/os-server-external-events => generated 1388 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1709500779", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ae194169-1c43-4713-9bac-e45364ca6179"}], "security_groups": [{"name": "tempest-securitygroup--487414581"}], "key_name": "tempest-keypair-1268128451", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:39 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] validate_networks() for [('ae194169-1c43-4713-9bac-e45364ca6179', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:52:40 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:52:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] Creating event network-vif-plugged:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-be3c16b5-ab19-482b-9c53-7ff39b2abce3 req-9a4ca994-3d38-4150-ba02-cb271c243488 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031957 Apr 13 21:52:40 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 147/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for project 73c23bc3e8b14441b4622095502b5dae. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Getting quotas for user 3f151b673e3d47acb9c3ed9b9ecaf687 and project 73c23bc3e8b14441b4622095502b5dae. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:52:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:52:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ea978cd-d272-416a-88b6-fb2f1548b89f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.978410 Apr 13 21:52:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 154/446] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:52:39 2023] POST /compute/v2.1/servers => generated 399 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:40 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0479efb9-571c-4cbc-88c3-80043c0b488b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1276 microversion: 2.20 time: 0.104367 Apr 13 21:52:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 146/447] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:40 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-unplugged", "status": "completed", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-plugged", "status": "completed", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Creating event network-vif-plugged:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Creating event network-vif-unplugged:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] Creating event network-vif-plugged:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d7cf6b0c-86e9-4527-b147-90ce624410ab req-e06513f7-bb5e-4496-8938-856c7dd01d6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.046976 Apr 13 21:52:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 148/448] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:41 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-deleted", "tag": "0ca8e06e-e964-4815-b2d8-a6c3fef7bf75"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] Creating event network-vif-deleted:0ca8e06e-e964-4815-b2d8-a6c3fef7bf75 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-39ccadce-ca81-48c3-a96d-28eb718bd937 req-1585367a-379c-4e47-ad5d-c8e63f633a95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030584 Apr 13 21:52:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 155/449] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-105177e1-959f-41fd-ab3a-7deba9b9a669 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-307927284", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f414347d-1c32-419c-89fc-b23b61a6c286", "destination_type": "local"}, {"source_type": "volume", "uuid": "f5d7cec7-b3e7-4a1e-9a25-a60366fd7618", "destination_type": "invalid"}], "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-105177e1-959f-41fd-ab3a-7deba9b9a669 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:52:43 user devstack@n-api.service[61663]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 13 21:52:43 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:52:43 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:52:43 user devstack@n-api.service[61663]: Connection: close Apr 13 21:52:43 user devstack@n-api.service[61663]: Content-Length: 493 Apr 13 21:52:43 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:52:43 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:52:43 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:52:43 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:52:43 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:52:43 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:52:43 user devstack@n-api.service[61663]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:52:43 user devstack@n-api.service[61663]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:52:43 user devstack@n-api.service[61663]: Apr 13 21:52:43 user devstack@n-api.service[61663]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-307927284", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f414347d-1c32-419c-89fc-b23b61a6c286", "destination_type": "local"}, {"source_type": "volume", "uuid": "f5d7cec7-b3e7-4a1e-9a25-a60366fd7618", "destination_type": "invalid"}], "networks": [{"uuid": "ed9169cc-af6d-4d31-9b2e-9016c5f963c4"}]}} Apr 13 21:52:43 user devstack@n-api.service[61663]: method: > Apr 13 21:52:43 user devstack@n-api.service[61663]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 21:52:43 user devstack@n-api.service[61663]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-307927284', 'imageRef': 'f414347d-1c32-419c-89fc-b23b61a6c286', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f414347d-1c32-419c-89fc-b23b61a6c286', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f5d7cec7-b3e7-4a1e-9a25-a60366fd7618', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'ed9169cc-af6d-4d31-9b2e-9016c5f963c4'}]}}} Apr 13 21:52:43 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise error Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi 'invalid' Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 13 21:52:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:52:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-105177e1-959f-41fd-ab3a-7deba9b9a669 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:52:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-105177e1-959f-41fd-ab3a-7deba9b9a669 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013823 Apr 13 21:52:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 147/450] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:52:43 2023] POST /compute/v2.1/servers => generated 155 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] Creating event network-changed:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:52:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-301fe951-fbff-4c18-b174-eb5c6356cee2 req-0d283891-41d1-45cc-8ba7-44ef826540d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Apr 13 21:52:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 156/451] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:44 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-76648d35-8239-4a28-8a52-02b6d6b4ebc3 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1493 microversion: 2.1 time: 0.206565 Apr 13 21:52:44 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 149/452] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:43 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1493 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:52:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-deleted", "tag": "38028ec5-f65f-44d7-a8f8-bc4470278334"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-deleted", "tag": "75e50a64-fb53-4613-b7b5-3cc00b4b9458"}, {"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-deleted", "tag": "2ade8fab-1fde-4730-aacc-fcb3b613c402"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Creating event network-vif-deleted:38028ec5-f65f-44d7-a8f8-bc4470278334 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Creating event network-vif-deleted:75e50a64-fb53-4613-b7b5-3cc00b4b9458 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] Creating event network-vif-deleted:2ade8fab-1fde-4730-aacc-fcb3b613c402 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e028d913-0ff3-4c05-91d4-651831e4e477 req-b40b9bbd-631f-4d5e-aeb5-258c1037bb3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038214 Apr 13 21:52:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 148/453] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f16c661a-6f38-43fe-a801-a69de6e687ea", "name": "network-vif-deleted", "tag": "f239b75b-16b7-4fcd-b3e3-d65f10278c43"}, {"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}, {"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:47 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Creating event network-vif-deleted:f239b75b-16b7-4fcd-b3e3-d65f10278c43 for instance f16c661a-6f38-43fe-a801-a69de6e687ea on user Apr 13 21:52:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:52:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:52:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-edb37c7b-b087-45eb-a2b1-0e22698cfa09 req-eca27a15-1bb3-4450-b2e5-7edb8ae65373 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051185 Apr 13 21:52:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 157/454] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:47 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=10 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Going to try to start instance {{(pid=61665) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 13 21:52:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-29081b28-6488-438f-b11f-24e6681a5156 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action" status: 202 len: 0 microversion: 2.1 time: 0.067110 Apr 13 21:52:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 150/455] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:52:49 2023] POST /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/action => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:49 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-933def20-8566-43fa-a27b-a399df0215c4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1648 microversion: 2.1 time: 0.204318 Apr 13 21:52:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 149/456] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:52:49 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1648 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:52:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1be67399-edaf-4d01-9325-5ae57a378570 req-13f66cb2-6dbd-4ea3-9d47-31f71f18df9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040174 Apr 13 21:52:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 158/457] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:53 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:53 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:53 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:52:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b98f20c7-c926-46d9-8dea-5cd4c07786e2 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1769 microversion: 2.87 time: 0.194960 Apr 13 21:52:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 151/458] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:52:52 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1769 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:52:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:52:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:52:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:52:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:52:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:52:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:52:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5b2d8ea8-2ca6-46c9-b134-337571398386 req-ae0b80d3-59b3-4487-bb9f-dbba6f244c4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029830 Apr 13 21:52:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 150/459] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ea079329-b9e8-4b0c-9922-04098c230143 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.230550 Apr 13 21:53:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 159/460] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:09 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HTTP exception thrown: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Request method failure captured: Apr 13 21:53:10 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac HTTP/1.1 Apr 13 21:53:10 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:53:10 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:53:10 user devstack@n-api.service[61665]: Connection: close Apr 13 21:53:10 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:53:10 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:53:10 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:53:10 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:53:10 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHkI7RXAGQ7Cfgbmh1TbL37boMBI7aUydUbnwrrEN23ibY0e7fTQIKKHCWN-B28jBJJuwNQuFFsnhQ7ctJY7LztSPnpDmu4k6Hf0jMeLH3NUkGoIl74-1X1hCt4tWp2sDyL2Gj9Qc6xTf7huosWaT8tyTZ3RvjzN78GAGIaClKJE2Fo Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Project-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Tenant: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Tenant-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-User: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:10 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:53:10 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:53:10 user devstack@n-api.service[61665]: X-User-Id: 331c3fa2628d466c9ae2729e269a5332 Apr 13 21:53:10 user devstack@n-api.service[61665]: X-User-Name: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:10 user devstack@n-api.service[61665]: method: > Apr 13 21:53:10 user devstack@n-api.service[61665]: exception: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:10 user devstack@n-api.service[61665]: action_args: {'id': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'} Apr 13 21:53:10 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Returning 404 to user: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-101f7237-56ed-4f9b-87f6-4e7c7fcb70e2 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 404 len: 111 microversion: 2.42 time: 0.050738 Apr 13 21:53:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 152/461] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:10 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:53:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=19 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=27 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6fe72318-dd8d-4b61-9846-9f46653ee5dc tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '.version_select at 0x7f4b3ca584c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:10 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6fe72318-dd8d-4b61-9846-9f46653ee5dc tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398543526" status: 204 len: 0 microversion: 2.42 time: 0.029114 Apr 13 21:53:10 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 151/462] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 21:53:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398543526 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HTTP exception thrown: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Request method failure captured: Apr 13 21:53:13 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac HTTP/1.1 Apr 13 21:53:13 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:53:13 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:53:13 user devstack@n-api.service[61664]: Connection: close Apr 13 21:53:13 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:53:13 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:53:13 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:53:13 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:53:13 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHkI7RXAGQ7Cfgbmh1TbL37boMBI7aUydUbnwrrEN23ibY0e7fTQIKKHCWN-B28jBJJuwNQuFFsnhQ7ctJY7LztSPnpDmu4k6Hf0jMeLH3NUkGoIl74-1X1hCt4tWp2sDyL2Gj9Qc6xTf7huosWaT8tyTZ3RvjzN78GAGIaClKJE2Fo Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Project-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Tenant: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Tenant-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-User: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:13 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:53:13 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:53:13 user devstack@n-api.service[61664]: X-User-Id: 331c3fa2628d466c9ae2729e269a5332 Apr 13 21:53:13 user devstack@n-api.service[61664]: X-User-Name: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:13 user devstack@n-api.service[61664]: method: > Apr 13 21:53:13 user devstack@n-api.service[61664]: exception: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:13 user devstack@n-api.service[61664]: action_args: {'id': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'} Apr 13 21:53:13 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Returning 404 to user: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d4c91fcc-ed49-439b-9354-bae4a00822f4 tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 404 len: 111 microversion: 2.42 time: 0.029832 Apr 13 21:53:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 160/463] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:53:13 2023] DELETE /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:53:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:13 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] [instance: 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] HTTP exception thrown: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Request method failure captured: Apr 13 21:53:14 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac HTTP/1.1 Apr 13 21:53:14 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:53:14 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:53:14 user devstack@n-api.service[61665]: Connection: close Apr 13 21:53:14 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:53:14 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:53:14 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:53:14 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:53:14 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHkI7RXAGQ7Cfgbmh1TbL37boMBI7aUydUbnwrrEN23ibY0e7fTQIKKHCWN-B28jBJJuwNQuFFsnhQ7ctJY7LztSPnpDmu4k6Hf0jMeLH3NUkGoIl74-1X1hCt4tWp2sDyL2Gj9Qc6xTf7huosWaT8tyTZ3RvjzN78GAGIaClKJE2Fo Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.42 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Project-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a2edca40d96494b8530f49a89dbd6e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Tenant: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Tenant-Id: 8a2edca40d96494b8530f49a89dbd6e6 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-438641289 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-User: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:14 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:53:14 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:53:14 user devstack@n-api.service[61665]: X-User-Id: 331c3fa2628d466c9ae2729e269a5332 Apr 13 21:53:14 user devstack@n-api.service[61665]: X-User-Name: tempest-TaggedBootDevicesTest_v242-438641289-project-member Apr 13 21:53:14 user devstack@n-api.service[61665]: method: > Apr 13 21:53:14 user devstack@n-api.service[61665]: exception: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:14 user devstack@n-api.service[61665]: action_args: {'id': '7905fecf-f246-4ed8-a5d4-9abdd3fb9cac'} Apr 13 21:53:14 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. Apr 13 21:53:14 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:14 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] Returning 404 to user: Instance 7905fecf-f246-4ed8-a5d4-9abdd3fb9cac could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8433bc58-b072-42a6-8d6d-8e1c23f16fee tempest-TaggedBootDevicesTest_v242-438641289 tempest-TaggedBootDevicesTest_v242-438641289-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac" status: 404 len: 111 microversion: 2.42 time: 0.030860 Apr 13 21:53:14 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 153/464] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:13 2023] GET /compute/v2.1/servers/7905fecf-f246-4ed8-a5d4-9abdd3fb9cac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:20 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-58f87358-b01f-45ac-b801-937651fc39fa tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1535 microversion: 2.1 time: 0.194641 Apr 13 21:53:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 152/465] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:20 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1535 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] [instance: af4efbd5-a4c1-4e7c-b274-92413f86f2a8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] HTTP exception thrown: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Request method failure captured: Apr 13 21:53:22 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 HTTP/1.1 Apr 13 21:53:22 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:53:22 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:53:22 user devstack@n-api.service[61664]: Connection: close Apr 13 21:53:22 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:53:22 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:53:22 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:53:22 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:53:22 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfl4mhM9UJ444_BM7QDExEqV9ziZQZ_U_oeA7yxOBoMg1lPwK49A5A1wOFyoZTldqlmDA1qmRDeV7KtwweolLwGCUbg4LymWzwZB_xicZ3K8nHy2GNlkLo7tPCFPSFfSwIf4vZOLl1WGxNX9PzhSdVWXkO75gqrPcQf8lvIPr0NjyI Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Project-Id: d4235a17cc95422dacb6386d4952fc8e Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1552707388 Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4235a17cc95422dacb6386d4952fc8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4235a17cc95422dacb6386d4952fc8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4235a17cc95422dacb6386d4952fc8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerStableDeviceRescueTest-1552707388 Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Tenant-Id: d4235a17cc95422dacb6386d4952fc8e Apr 13 21:53:22 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1552707388 Apr 13 21:53:22 user devstack@n-api.service[61664]: X-User: tempest-ServerStableDeviceRescueTest-1552707388-project-member Apr 13 21:53:22 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:53:22 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:53:22 user devstack@n-api.service[61664]: X-User-Id: c3c1bbf573ea436293abf4debdecc515 Apr 13 21:53:22 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerStableDeviceRescueTest-1552707388-project-member Apr 13 21:53:22 user devstack@n-api.service[61664]: method: > Apr 13 21:53:22 user devstack@n-api.service[61664]: exception: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. Apr 13 21:53:22 user devstack@n-api.service[61664]: action_args: {'id': 'af4efbd5-a4c1-4e7c-b274-92413f86f2a8'} Apr 13 21:53:22 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. Apr 13 21:53:22 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Returning 404 to user: Instance af4efbd5-a4c1-4e7c-b274-92413f86f2a8 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-212ba9f1-1d88-4dac-8f42-466a4aa4181f tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8" status: 404 len: 111 microversion: 2.1 time: 0.029353 Apr 13 21:53:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 161/466] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:22 2023] GET /compute/v2.1/servers/af4efbd5-a4c1-4e7c-b274-92413f86f2a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:53:22 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-40cfe910-2e71-4d66-a3bc-2ff2b3342589 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] Calling method '.version_select at 0x7f4b3cb83400>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-40cfe910-2e71-4d66-a3bc-2ff2b3342589 tempest-ServerStableDeviceRescueTest-1552707388 tempest-ServerStableDeviceRescueTest-1552707388-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172830782" status: 202 len: 0 microversion: 2.1 time: 0.024328 Apr 13 21:53:22 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 154/467] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 21:53:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172830782 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HTTP exception thrown: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Request method failure captured: Apr 13 21:53:27 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea HTTP/1.1 Apr 13 21:53:27 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:53:27 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:53:27 user devstack@n-api.service[61663]: Connection: close Apr 13 21:53:27 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:53:27 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:53:27 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:53:27 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:53:27 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHkVHTlJUnyEsECCEAkcLhnBJt1d8hTzT2aGL7eSn7ghq6x1qnCrZvay9v0ME-uvgmHZu4reUSfcE82L0rLg2oYfKI6vY5gvO_Fca55BTL8u35EwFSLRagOAzpEznjn3h2YYMn7KXTwPbI2Lewh4GcyD8yMVGP-R4Kc0Oj86lTDs3-Y Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Project-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Tenant-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:27 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:27 user devstack@n-api.service[61663]: X-User: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:27 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:53:27 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:53:27 user devstack@n-api.service[61663]: X-User-Id: 2446d7b79d7f4879ab857ab6a10777aa Apr 13 21:53:27 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:27 user devstack@n-api.service[61663]: method: > Apr 13 21:53:27 user devstack@n-api.service[61663]: exception: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:27 user devstack@n-api.service[61663]: action_args: {'id': 'f16c661a-6f38-43fe-a801-a69de6e687ea'} Apr 13 21:53:27 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Returning 404 to user: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4390ac1b-b5a4-4ce5-a551-7edaf512c044 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 404 len: 111 microversion: 2.32 time: 0.031937 Apr 13 21:53:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 153/468] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:27 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:53:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-07401b5c-5c10-4f5f-bc72-6397c273ffc8 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '.version_select at 0x7f4b3cad6a70>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-07401b5c-5c10-4f5f-bc72-6397c273ffc8 tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-113663637" status: 204 len: 0 microversion: 2.32 time: 0.035340 Apr 13 21:53:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 162/469] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 13 21:53:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-113663637 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:30 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-da9ad5c0-436d-4f68-88f0-27c63d21cab9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1586 microversion: 2.20 time: 0.151304 Apr 13 21:53:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 155/470] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:30 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1586 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HTTP exception thrown: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Request method failure captured: Apr 13 21:53:31 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea HTTP/1.1 Apr 13 21:53:31 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:53:31 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:53:31 user devstack@n-api.service[61663]: Connection: close Apr 13 21:53:31 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:53:31 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:53:31 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:53:31 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:53:31 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHkVHTlJUnyEsECCEAkcLhnBJt1d8hTzT2aGL7eSn7ghq6x1qnCrZvay9v0ME-uvgmHZu4reUSfcE82L0rLg2oYfKI6vY5gvO_Fca55BTL8u35EwFSLRagOAzpEznjn3h2YYMn7KXTwPbI2Lewh4GcyD8yMVGP-R4Kc0Oj86lTDs3-Y Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Project-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Project-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Tenant: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Tenant-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:31 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61663]: X-User: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:31 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:53:31 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:53:31 user devstack@n-api.service[61663]: X-User-Id: 2446d7b79d7f4879ab857ab6a10777aa Apr 13 21:53:31 user devstack@n-api.service[61663]: X-User-Name: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:31 user devstack@n-api.service[61663]: method: > Apr 13 21:53:31 user devstack@n-api.service[61663]: exception: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61663]: action_args: {'id': 'f16c661a-6f38-43fe-a801-a69de6e687ea'} Apr 13 21:53:31 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Returning 404 to user: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7a2e1f6f-f9ec-4e1e-b3eb-a1c45caee15c tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 404 len: 111 microversion: 2.32 time: 0.053772 Apr 13 21:53:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 154/471] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:53:31 2023] DELETE /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] [instance: f16c661a-6f38-43fe-a801-a69de6e687ea] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] HTTP exception thrown: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Request method failure captured: Apr 13 21:53:31 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea HTTP/1.1 Apr 13 21:53:31 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:53:31 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:53:31 user devstack@n-api.service[61664]: Connection: close Apr 13 21:53:31 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:53:31 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:53:31 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:53:31 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:53:31 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHkVHTlJUnyEsECCEAkcLhnBJt1d8hTzT2aGL7eSn7ghq6x1qnCrZvay9v0ME-uvgmHZu4reUSfcE82L0rLg2oYfKI6vY5gvO_Fca55BTL8u35EwFSLRagOAzpEznjn3h2YYMn7KXTwPbI2Lewh4GcyD8yMVGP-R4Kc0Oj86lTDs3-Y Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.32 Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Project-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Project-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1f969510e1734ad4bf48a8c0a3d7ae8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Tenant: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Tenant-Id: 1f969510e1734ad4bf48a8c0a3d7ae8f Apr 13 21:53:31 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1783658683 Apr 13 21:53:31 user devstack@n-api.service[61664]: X-User: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:31 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:53:31 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:53:31 user devstack@n-api.service[61664]: X-User-Id: 2446d7b79d7f4879ab857ab6a10777aa Apr 13 21:53:31 user devstack@n-api.service[61664]: X-User-Name: tempest-TaggedBootDevicesTest-1783658683-project-member Apr 13 21:53:31 user devstack@n-api.service[61664]: method: > Apr 13 21:53:31 user devstack@n-api.service[61664]: exception: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61664]: action_args: {'id': 'f16c661a-6f38-43fe-a801-a69de6e687ea'} Apr 13 21:53:31 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. Apr 13 21:53:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] Returning 404 to user: Instance f16c661a-6f38-43fe-a801-a69de6e687ea could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ef4e0319-b422-4e3a-986d-5118f15e155a tempest-TaggedBootDevicesTest-1783658683 tempest-TaggedBootDevicesTest-1783658683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea" status: 404 len: 111 microversion: 2.32 time: 0.054381 Apr 13 21:53:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 163/472] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:31 2023] GET /compute/v2.1/servers/f16c661a-6f38-43fe-a801-a69de6e687ea => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 13 21:53:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8057bdb7-c4a1-4b8a-954c-a86ed0939c8a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cb83880>, body: {"keypair": {"name": "tempest-keypair-130014745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKJiqdp3UBkP4HWGZ5pWWYRJwdY0AOytmb2C1U8rxnqJI+4BzVnFyxZoE6lJ7BrL1WIxSTz0CI4SBaf/l6Xft8tRo7bYgdhhDCuyQIZN1/utqRkjzxMGWh3aakpxsff6Q=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-8057bdb7-c4a1-4b8a-954c-a86ed0939c8a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:53:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-8057bdb7-c4a1-4b8a-954c-a86ed0939c8a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:53:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8057bdb7-c4a1-4b8a-954c-a86ed0939c8a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.207226 Apr 13 21:53:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 156/473] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:53:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7b895136-3507-4060-bfec-303ffcf5148f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: .version_select at 0x7f4b3ca5a200>, body: {"keypair": {"name": "tempest-keypair-1299306137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEkikMBfKYBaVz9RAPAAHtgluCulNhaXlNnXRmd1wytRaQFaosDdHshmuQB0as4KbHDZo1Ux4sl5RXfhe13p5VrH2Y8uYO2igQjKNR7Nb3FHusXdWK16NLMOw2+fvY10Q=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1694878634", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88d8592d-4fff-4951-a1b8-140984c24696"}], "security_groups": [{"name": "tempest-securitygroup--1552488684"}], "key_name": "tempest-keypair-130014745", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:38 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7b895136-3507-4060-bfec-303ffcf5148f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for project 70e84a09a76a44eb830e575db4321224. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:53:38 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7b895136-3507-4060-bfec-303ffcf5148f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for user e77459bc3fa8496da1a089c460e32ed2 and project 70e84a09a76a44eb830e575db4321224. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:53:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7b895136-3507-4060-bfec-303ffcf5148f tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068723 Apr 13 21:53:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 155/474] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:53:38 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] validate_networks() for [('88d8592d-4fff-4951-a1b8-140984c24696', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:53:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:53:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ed7e67bb-20f5-46a5-b738-e8503a0c5d4b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.754349 Apr 13 21:53:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 164/475] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:53:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:53:38 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3ad3b3ac-5fc5-45eb-9252-9b3ba59e2a99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:38 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3ad3b3ac-5fc5-45eb-9252-9b3ba59e2a99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:38 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-3ad3b3ac-5fc5-45eb-9252-9b3ba59e2a99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3ad3b3ac-5fc5-45eb-9252-9b3ba59e2a99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 200 len: 1235 microversion: 2.1 time: 0.079964 Apr 13 21:53:38 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 157/476] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:38 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4a0283c6-56c7-4d08-8d28-b6766b94950c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1652 microversion: 2.1 time: 0.196864 Apr 13 21:53:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 156/477] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:39 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1652 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-83885280", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0a365911-1489-441d-8c9a-91c593bb18af"}], "security_groups": [{"name": "tempest-securitygroup--996151797"}], "key_name": "tempest-keypair-1299306137", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] validate_networks() for [('0a365911-1489-441d-8c9a-91c593bb18af', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=15 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Getting quotas for user e77459bc3fa8496da1a089c460e32ed2 and project 70e84a09a76a44eb830e575db4321224. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:53:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:53:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6ecc5170-0afa-4906-9877-c78a4f14e7f4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.672530 Apr 13 21:53:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 165/478] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:53:40 2023] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 13 21:53:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-875a786f-1bba-4150-b8ed-9260cc4535b9 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:40 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-875a786f-1bba-4150-b8ed-9260cc4535b9 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:40 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:40 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-875a786f-1bba-4150-b8ed-9260cc4535b9 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-875a786f-1bba-4150-b8ed-9260cc4535b9 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1238 microversion: 2.1 time: 0.082738 Apr 13 21:53:40 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 158/479] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:40 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] Creating event network-changed:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:53:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ebb139ee-8403-4ef7-8f6f-2b12da8a0601 req-6cceef86-9e84-4e47-bd3e-dd59ee2d3bac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039640 Apr 13 21:53:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 157/480] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:53:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "name": "network-vif-plugged", "status": "completed", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] Creating event network-vif-plugged:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:53:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7b7c9d98-289f-4be6-a92b-9dbcd27d65c3 req-ad9dde90-064f-4c6e-9290-4d2b368e091b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034634 Apr 13 21:53:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 166/481] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "name": "network-vif-plugged", "status": "completed", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}, {"name": "network-changed", "server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:47 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Creating event network-vif-plugged:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:53:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] Creating event network-changed:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:53:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-fce07b58-3588-44c6-a5c8-57edc5fce28c req-1b579eb4-7602-4b9c-9a16-f7ffe03dc57c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043690 Apr 13 21:53:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 159/482] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:46 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}, {"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:53:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:53:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ef6f919f-1947-4001-99e7-bab66e18f6e8 req-77b6e2a6-1743-4e2f-aafa-d0965bc8ad38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041409 Apr 13 21:53:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 158/483] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=12 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] HTTP exception thrown: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:53:50 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f HTTP/1.1 Apr 13 21:53:50 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:53:50 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:53:50 user devstack@n-api.service[61664]: Connection: close Apr 13 21:53:50 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:53:50 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:53:50 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:53:50 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:53:50 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:53:50 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:53:50 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:53:50 user devstack@n-api.service[61664]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:53:50 user devstack@n-api.service[61664]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:53:50 user devstack@n-api.service[61664]: method: > Apr 13 21:53:50 user devstack@n-api.service[61664]: exception: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61664]: action_args: {'id': 'eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f'} Apr 13 21:53:50 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 404 to user: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-147bbd73-b3dd-4620-85b2-1f84ac69ebcb tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 404 len: 111 microversion: 2.1 time: 0.040097 Apr 13 21:53:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 167/484] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:53:50 2023] DELETE /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=8 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] HTTP exception thrown: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:53:50 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f HTTP/1.1 Apr 13 21:53:50 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:53:50 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:53:50 user devstack@n-api.service[61665]: Connection: close Apr 13 21:53:50 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:53:50 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:53:50 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:53:50 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:53:50 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:53:50 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:53:50 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:53:50 user devstack@n-api.service[61665]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:53:50 user devstack@n-api.service[61665]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:53:50 user devstack@n-api.service[61665]: method: > Apr 13 21:53:50 user devstack@n-api.service[61665]: exception: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61665]: action_args: {'id': 'eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f'} Apr 13 21:53:50 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. Apr 13 21:53:50 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:53:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 404 to user: Instance eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:53:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ddd849f5-9fd6-4a53-8d94-d3b4e8ccfae0 tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f" status: 404 len: 111 microversion: 2.1 time: 0.038587 Apr 13 21:53:50 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 160/485] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:50 2023] GET /compute/v2.1/servers/eb6a98f5-5cf0-456e-9ca8-a3b70e1b962f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=21 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:53:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:53:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bee95604-2b3f-4c77-aad0-9191cc27db6e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 204 len: 0 microversion: 2.1 time: 0.145007 Apr 13 21:53:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 159/486] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:53:50 2023] DELETE /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:51 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02a7fc7a42b441cfa3c6bc04f4dd6cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1071d640fb44ff9966fab7888668ed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-10b0a276-8c1d-465e-9689-8fb0367f387f tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 200 len: 1499 microversion: 2.1 time: 0.275638 Apr 13 21:53:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 168/487] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:53:51 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 1499 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:53:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "name": "network-vif-unplugged", "status": "completed", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] Creating event network-vif-unplugged:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:53:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-42e203d9-17dd-41d3-87ec-858053c32967 req-2b1d7855-e3d1-4830-8ba8-a3015da3dbd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047666 Apr 13 21:53:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 161/488] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "name": "network-vif-deleted", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] Creating event network-vif-deleted:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:53:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b18ef3c3-12f4-4d50-98d8-563d1cc8be02 req-016ae29b-8735-48f5-8151-a8e41a4bc97e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053192 Apr 13 21:53:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 160/489] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8645ede7-1e10-4520-8092-6cc6dfc3d82a", "name": "network-vif-plugged", "status": "completed", "tag": "ba4d973f-18b3-4b49-b663-627155851ce8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] Creating event network-vif-plugged:ba4d973f-18b3-4b49-b663-627155851ce8 for instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a on user Apr 13 21:53:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-05a58b6b-54fb-4631-9010-5739e492afad req-9640d1b3-19c7-43e5-ad4c-365754d98071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038110 Apr 13 21:53:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 169/490] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "89ddd8a5-995e-42f7-8315-c0834fd3d45a"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:53 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'flavor' on Instance uuid 6fbf2022-b069-440f-8513-6d107f0a7180 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:53:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c42ca6c6-6543-4aab-9389-30f24fa1f4ce tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180/action" status: 200 len: 29 microversion: 2.87 time: 0.639088 Apr 13 21:53:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 162/491] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:53:53 2023] POST /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180/action => generated 29 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:53:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b81be6b7-31ae-4713-b276-150fd798c6da tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1775 microversion: 2.87 time: 0.284648 Apr 13 21:53:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 161/492] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:53:54 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1775 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:53:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-unplugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] Creating event network-vif-unplugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:53:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-66f04f38-aff9-4e52-b081-2f72e7de4d20 req-3a61f9bf-40f4-4b15-b5f1-98b18d57e40f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052821 Apr 13 21:53:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 170/493] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:53:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:53:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:53:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:53:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:53:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:53:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-91b1ee35-5147-4179-ad23-0659560462e1 req-51bae466-f5bc-45e1-9c13-0d91e647da48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049631 Apr 13 21:53:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 163/494] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:53:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:54:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c4e10830-d3e8-498e-be12-952d522638af req-1fe6347b-f61c-4bcf-975b-c0e482299e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035919 Apr 13 21:54:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 162/495] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:54:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5a5f9658-9169-4eea-8980-3e65070eed34 req-f9583d4b-c14d-4407-8d26-a8b003e298ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Apr 13 21:54:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 171/496] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=13 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-38090163", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "dd758252-0db3-4d47-a231-c8a85e067e9b"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:08 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] validate_networks() for [('dd758252-0db3-4d47-a231-c8a85e067e9b', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting quotas for project efd2e9bf0c5345f6bd3f030fb9f55e03. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting quotas for user 9fe6b951236f4a96a2ac12a5dea4602a and project efd2e9bf0c5345f6bd3f030fb9f55e03. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:54:09 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:54:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-eb075e88-ee9d-4e64-9442-2eb6856da03e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.494356 Apr 13 21:54:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 164/497] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:54:08 2023] POST /compute/v2.1/servers => generated 378 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:54:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-240d877d-7b90-4a94-84b3-4e23bc74d45b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:09 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-240d877d-7b90-4a94-84b3-4e23bc74d45b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:09 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-240d877d-7b90-4a94-84b3-4e23bc74d45b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-240d877d-7b90-4a94-84b3-4e23bc74d45b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45" status: 200 len: 1206 microversion: 2.1 time: 0.071851 Apr 13 21:54:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 163/498] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:09 2023] GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 => generated 1206 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:10 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b41b8d5d-d290-487d-a317-38d5950a35cf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.436306 Apr 13 21:54:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 172/499] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:09 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:10 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7222c4a6-ed5b-4b29-ad65-ecce1762555d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.292327 Apr 13 21:54:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 165/500] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:10 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:12 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] Creating event network-changed:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:54:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-904c4b12-3940-409a-b2bc-59a011d42479 req-c10ae2f1-3277-4b39-a538-4b50c881d2d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033070 Apr 13 21:54:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 164/501] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "name": "network-vif-plugged", "status": "completed", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=24 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] Creating event network-vif-plugged:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:54:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-58e426f2-3b74-473d-b618-bffcbdb7b477 req-196af144-46ac-405c-af6d-4cfefb2f8936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050049 Apr 13 21:54:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 173/502] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "name": "network-vif-plugged", "status": "completed", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] Creating event network-vif-plugged:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:54:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-acdd5e09-2e91-4ada-8853-c5d97f014f8e req-407f9891-fef6-4f0e-b29d-0873bcee6818 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038367 Apr 13 21:54:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 166/503] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:20 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-af18a4e2-8c47-4c68-b858-aa388838fa23 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1535 microversion: 2.1 time: 0.175264 Apr 13 21:54:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 165/504] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:20 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Searching by: {'deleted': False, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4'} {{(pid=61664) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:21 user devstack@n-api.service[61664]: DEBUG nova.compute.multi_cell_list [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61664) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 13 21:54:21 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-650f7f79-71ca-4ff2-b33a-a4501a764db8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.091358 Apr 13 21:54:21 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 174/505] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 13 21:54:21 2023] GET /compute/v2.1/servers => generated 340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:21 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-df9054a0-393d-41d0-ab19-a940a63b6fd9 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1535 microversion: 2.1 time: 0.165500 Apr 13 21:54:21 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 167/506] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:21 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1535 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:22 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:22 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-33efd6aa-178d-4582-8b3a-6934c2aa8823 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319104 Apr 13 21:54:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 166/507] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:54:22 2023] POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:29 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-377cdcaf-a09c-49c6-a727-6abdfe3a569c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 200 len: 1545 microversion: 2.1 time: 0.150409 Apr 13 21:54:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 175/508] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:28 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 1545 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:31 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ba66db62-bb29-4152-bdee-34fe98506f27 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1551 microversion: 2.1 time: 0.294997 Apr 13 21:54:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 168/509] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:30 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1551 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-98873680-0d4b-49ae-a84f-487389304028 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.220352 Apr 13 21:54:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 167/510] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 13 21:54:31 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-interface => generated 282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:54:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:32 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] Creating event network-changed:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:54:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-27401d90-22d2-4dd7-abce-e8af66f68d69 req-2198badd-d02c-4b18-9720-9707ed9f1d47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036060 Apr 13 21:54:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 176/511] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-14ffff1a-588a-4b0f-b55e-644cde8bc6de tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/ips" status: 200 len: 109 microversion: 2.20 time: 0.047058 Apr 13 21:54:32 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 169/512] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 13 21:54:32 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/ips => generated 109 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-aa41f7c7-7bf8-4351-9965-d9f72a6cde57 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1581 microversion: 2.1 time: 0.213083 Apr 13 21:54:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 168/513] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:33 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1581 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:34 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lazy-loading 'flavor' on Instance uuid 2d1990a1-40ec-4c02-941f-813c22e8cd8f {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:54:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] Creating event network-changed:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-9a88ad08-c453-4b0f-8617-b84f5c212492 req-add6aa1f-ac1f-4355-87c1-227a279cfb90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Apr 13 21:54:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 170/514] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-58fb1b59-05f3-40d9-966e-610f9f2c9f8b tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/action" status: 202 len: 0 microversion: 2.20 time: 1.166347 Apr 13 21:54:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 177/515] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:54:34 2023] POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/action => generated 0 bytes in 1168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e298174b-94e2-4f46-890f-56c43bdfa661 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1711 microversion: 2.20 time: 0.263191 Apr 13 21:54:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 169/516] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:54:35 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1711 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-944999147"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:36 user devstack@n-api.service[61665]: INFO nova.network.security_group_api [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Adding security group a34294e1-9f54-43e8-82c3-0e04985c247e to port 0150fcfb-793e-4d51-966c-c30195a9802f Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-unplugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}, {"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Creating event network-vif-unplugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:54:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:54:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-dfea2973-6696-40d0-9e61-908c5b1300fb req-b8095bb8-0883-4a79-b234-3cdccb6accc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031300 Apr 13 21:54:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 178/517] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:54:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a4793127-964e-41ae-b075-e1e8767740a2 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action" status: 202 len: 0 microversion: 2.1 time: 1.053932 Apr 13 21:54:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 171/518] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:54:36 2023] POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:54:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] Creating event network-changed:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-2770dc19-aba6-45e3-98ff-946352e07288 req-079eb42d-9305-4723-9520-9d0f44a9f2d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033574 Apr 13 21:54:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 170/519] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:37 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5e7f2bc9-4413-46da-acd2-f5a89d3d0a24 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1745 microversion: 2.1 time: 0.190087 Apr 13 21:54:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 179/520] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:37 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-59d9c0ef-ce20-4841-bb84-4165d89ce61a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action" status: 202 len: 0 microversion: 2.1 time: 0.216366 Apr 13 21:54:38 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 172/521] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:54:37 2023] POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:38 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2b6caf33-bbf1-4d0b-a740-3b2436153432 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1737 microversion: 2.1 time: 0.188136 Apr 13 21:54:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 171/522] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:38 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-92df7cea-3642-4a77-a96a-729258df3393 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047004 Apr 13 21:54:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 180/523] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:54:39 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:40 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:54:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e986e66e-e8d1-48f4-be0b-163736ba0752 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 204 len: 0 microversion: 2.1 time: 0.126720 Apr 13 21:54:40 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 173/524] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:54:40 2023] DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-03fd0884-25ef-4166-af84-fc57000a6501 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 200 len: 1658 microversion: 2.1 time: 0.175190 Apr 13 21:54:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 172/525] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:40 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 1658 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-unplugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] Creating event network-vif-unplugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:54:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7099a724-f228-4338-8d23-6abd6ad4d838 req-94809cb3-7105-465c-a12a-9b21e60087b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051421 Apr 13 21:54:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 181/526] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] [instance: 8645ede7-1e10-4520-8092-6cc6dfc3d82a] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] HTTP exception thrown: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Request method failure captured: Apr 13 21:54:41 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a HTTP/1.1 Apr 13 21:54:41 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:54:41 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:54:41 user devstack@n-api.service[61665]: Connection: close Apr 13 21:54:41 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:54:41 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:54:41 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:54:41 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:54:41 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfhXLAH3GkIEt6z7DIGITqYYqqXIoc8xq8qyMaqBD8e9ZGb0oS5NuPCgpcfh2FuGrcK0A9Vc7F90hQcTlwL_OlmqIuC3DBhUGmzk2W0RmJQ2SL7D7DSP2Ky6ZkXLrl1qcb0A6hYZw34KOD3ojbVG2NGX3Yofr9nUrUJoD4yDGVz3k0 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Project-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1071d640fb44ff9966fab7888668ed5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Tenant: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Tenant-Id: f1071d640fb44ff9966fab7888668ed5 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1571285098 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-User: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:54:41 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:54:41 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:54:41 user devstack@n-api.service[61665]: X-User-Id: 02a7fc7a42b441cfa3c6bc04f4dd6cb9 Apr 13 21:54:41 user devstack@n-api.service[61665]: X-User-Name: tempest-ServersNegativeTestJSON-1571285098-project-member Apr 13 21:54:41 user devstack@n-api.service[61665]: method: > Apr 13 21:54:41 user devstack@n-api.service[61665]: exception: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. Apr 13 21:54:41 user devstack@n-api.service[61665]: action_args: {'id': '8645ede7-1e10-4520-8092-6cc6dfc3d82a'} Apr 13 21:54:41 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. Apr 13 21:54:41 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:54:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] Returning 404 to user: Instance 8645ede7-1e10-4520-8092-6cc6dfc3d82a could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:54:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bd3ba319-e944-40b7-959d-2d194a5ba79e tempest-ServersNegativeTestJSON-1571285098 tempest-ServersNegativeTestJSON-1571285098-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a" status: 404 len: 111 microversion: 2.1 time: 0.033413 Apr 13 21:54:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 174/527] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:41 2023] GET /compute/v2.1/servers/8645ede7-1e10-4520-8092-6cc6dfc3d82a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:54:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-unplugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] Creating event network-vif-unplugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b32accde-e7dd-42ab-b56a-1a9319c9a51a req-3e7a0c86-781b-41db-b986-d8fb81d03315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044047 Apr 13 21:54:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 173/528] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-plugged", "status": "completed", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}, {"name": "network-changed", "server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Creating event network-vif-plugged:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:54:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.compute.server_external_events [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] Unable to find a host for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f. Dropping event network-changed {{(pid=61664) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 13 21:54:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-61bebde5-aad5-4098-847a-e615bef8bf24 req-f625bf7d-59bf-47b6-83f0-61405ca85d1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 347 microversion: 2.1 time: 0.045961 Apr 13 21:54:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 182/529] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 347 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 13 21:54:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddc7aa71-95a1-4a3c-a5c1-746b86a011c2", "name": "network-vif-deleted", "tag": "a70898ac-83fd-4f25-be37-aef7c87f6059"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-unplugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-deleted:a70898ac-83fd-4f25-be37-aef7c87f6059 for instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-unplugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-98a1de33-2e41-44f3-9d2d-d19de0852755 req-5827b03f-86a5-43e8-84ee-7326316596c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1211 microversion: 2.1 time: 0.052099 Apr 13 21:54:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 175/530] 10.0.0.210 () {68 vars in 1395 bytes} [Thu Apr 13 21:54:43 2023] POST /compute/v2.1/os-server-external-events => generated 1211 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1f59ecfc-bb1c-47c5-b128-8e27ed1edb18 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1755 microversion: 2.87 time: 0.370192 Apr 13 21:54:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 174/531] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:54:44 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1755 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:54:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:54:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:45 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:54:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-022a21b3-861e-4079-a222-70af42cdfa38 req-39a1cb6b-393b-419b-8a83-4021b36f6dbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035422 Apr 13 21:54:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 183/532] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:54:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:54:59 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:54:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e613c586-0dfc-45a3-8c01-aad689f07bdb tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45" status: 200 len: 1484 microversion: 2.1 time: 0.457685 Apr 13 21:54:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 176/533] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:54:59 2023] GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 => generated 1484 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=19 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:10 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:11 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lazy-loading 'services' on Instance uuid c895d9cf-e6c1-42d6-88e3-1209b203fbe3 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:55:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1d7f1bcc-fe1c-42c2-9d83-b7d6358b3016 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments/6c038cb0-7b1c-4305-97d8-318974560720" status: 202 len: 0 microversion: 2.1 time: 0.331027 Apr 13 21:55:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 175/534] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:55:10 2023] DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments/6c038cb0-7b1c-4305-97d8-318974560720 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=21 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4c58d6c9-7b3c-48ff-b931-c3688806be74 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052271 Apr 13 21:55:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 184/535] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:55:11 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1202537126", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "3b93cbae-1a6b-4c9c-9c82-e49108002327", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:55:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3b93cbae-1a6b-4c9c-9c82-e49108002327',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:55:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c5c69be0-e815-4f25-9823-75c49baa55a9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.555038 Apr 13 21:55:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 177/536] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:55:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:55:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-bdaeca2f-2466-4bcf-bcb7-f1074c170431 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-bdaeca2f-2466-4bcf-bcb7-f1074c170431 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:16 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-bdaeca2f-2466-4bcf-bcb7-f1074c170431 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-bdaeca2f-2466-4bcf-bcb7-f1074c170431 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 200 len: 1052 microversion: 2.1 time: 0.062697 Apr 13 21:55:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 176/537] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:16 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 1052 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:55:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] Creating event network-changed:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:55:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-53ca99f8-850c-4602-b9b6-5f4c0965ae24 req-4de92a1f-f16d-4427-b99f-625024f4d548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358077 Apr 13 21:55:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 185/538] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:26 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:26 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-be56c7b4-ac9c-48a8-9b1f-a84bc060c58d tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1652 microversion: 2.20 time: 0.153414 Apr 13 21:55:26 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 178/539] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:55:26 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:28 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-06b061da-36d9-42ca-acae-8d43da98af7c tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1745 microversion: 2.1 time: 0.161558 Apr 13 21:55:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 177/540] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:28 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=9 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2af6ddf4-dc8c-4fb1-bee6-e952ad72892d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.136190 Apr 13 21:55:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 186/541] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:55:29 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] Creating event network-changed:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:55:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-3a23f109-4c12-45ef-9bdf-6dc055101ce4 req-09184277-52f1-49b4-b4b1-41e46237b2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028635 Apr 13 21:55:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 179/542] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b0006c04-8199-45f0-8dec-54b01b9bb38b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/ips" status: 200 len: 108 microversion: 2.1 time: 0.035539 Apr 13 21:55:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 178/543] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:55:30 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:55:30 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 HTTP/1.1 Apr 13 21:55:30 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:55:30 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:55:30 user devstack@n-api.service[61664]: Connection: close Apr 13 21:55:30 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:55:30 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:55:30 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:55:30 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:55:30 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:55:30 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:55:30 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:55:30 user devstack@n-api.service[61664]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:55:30 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:55:30 user devstack@n-api.service[61664]: method: > Apr 13 21:55:30 user devstack@n-api.service[61664]: exception: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:55:30 user devstack@n-api.service[61664]: action_args: {'id': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'} Apr 13 21:55:30 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:55:30 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "name": "network-vif-plugged", "status": "completed", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:55:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f85ddb68-91e9-406a-9c38-0b2ff647fbde tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 404 len: 111 microversion: 2.1 time: 0.037009 Apr 13 21:55:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 187/544] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:30 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:55:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-623de1a9-0e33-4c04-a16c-174f055b5f2f tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '.version_select at 0x7f4b3cec31c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] Creating event network-vif-plugged:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:55:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-623de1a9-0e33-4c04-a16c-174f055b5f2f tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789187285" status: 202 len: 0 microversion: 2.1 time: 0.025648 Apr 13 21:55:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 179/545] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 21:55:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789187285 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:55:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-671d4c2b-b98a-4571-a60f-22c9f4cbfa75 req-f610b41a-c600-467e-81d5-51ca19d311e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 Apr 13 21:55:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 180/546] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-78e9dd7b-7d4b-4b65-899a-faffe468dd08 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad2950>, body: {"keypair": {"name": "tempest-keypair-1585186331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGsNbk24v9gRwINKBHxnvwkpynX5ApVk07JfuyA5Y8CkVYfwSmGLiy3Yb85Bd5j3v3egJvdO0SGKRzUdcKUmZwBQQD/pQ4Siu2lstEO6sNPuVcdj1xLfaPETf+n2/dHlw=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:31 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-78e9dd7b-7d4b-4b65-899a-faffe468dd08 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for project 3605d609b52b431993bcea0798a77554. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:55:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-670cd69d-d645-43fd-b446-40b44803611c tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.125562 Apr 13 21:55:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 188/547] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:55:31 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-interface => generated 282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:31 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-78e9dd7b-7d4b-4b65-899a-faffe468dd08 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for user 60e4dadf9d9e41e6a91ee03a0cd50dc3 and project 3605d609b52b431993bcea0798a77554. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:55:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-78e9dd7b-7d4b-4b65-899a-faffe468dd08 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079903 Apr 13 21:55:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 180/548] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:55:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314899e4-f6f0-4aba-a3cb-60eca54e6808"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:32 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "name": "network-vif-plugged", "status": "completed", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] Creating event network-vif-plugged:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:55:32 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-9d0339bb-6307-49e8-8c18-ce38797fbec0 req-4ec9578d-d7d8-4821-ac56-530d6db09fec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145060 Apr 13 21:55:32 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 181/549] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a3bb043-64a5-42ac-afa3-e4f0896f84d4"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4426a694-0802-4aba-a68b-cc5fc8a4f958 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422630 Apr 13 21:55:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 189/550] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:55:32 2023] POST /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-caf61ba9-932d-4a33-9a6a-189a2afbd203 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490010 Apr 13 21:55:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 181/551] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:55:33 2023] POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1947981713", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "05504462-8db4-4453-90fd-55cfd765138e"}], "security_groups": [{"name": "tempest-securitygroup--1572536392"}], "key_name": "tempest-keypair-1585186331", "user_data": "}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] validate_networks() for [('05504462-8db4-4453-90fd-55cfd765138e', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for project 3605d609b52b431993bcea0798a77554. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Getting quotas for user 60e4dadf9d9e41e6a91ee03a0cd50dc3 and project 3605d609b52b431993bcea0798a77554. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:55:34 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:55:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-77747b9e-e387-4314-b560-0ae78b5a2526 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.679348 Apr 13 21:55:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 182/552] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:55:33 2023] POST /compute/v2.1/servers => generated 400 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:55:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-33b0bd5a-6459-4e49-86dd-50484e08c2a9 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-33b0bd5a-6459-4e49-86dd-50484e08c2a9 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:34 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-33b0bd5a-6459-4e49-86dd-50484e08c2a9 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-33b0bd5a-6459-4e49-86dd-50484e08c2a9 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 200 len: 1232 microversion: 2.1 time: 0.074862 Apr 13 21:55:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 190/553] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:34 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 1232 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:55:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] Creating event network-changed:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:55:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-1781d903-f617-4071-9888-46f2574cc63e req-7456cd97-80dd-452a-957b-b8c2951a7408 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029460 Apr 13 21:55:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 182/554] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] Creating event network-changed:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:55:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-6317062e-631f-45f0-a1e2-e42ff8f9c254 req-21205e74-fca1-404a-8525-7ec2bb1a0c1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050493 Apr 13 21:55:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 183/555] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "name": "network-vif-plugged", "status": "completed", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] Creating event network-vif-plugged:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:55:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-fb1ed845-04f6-469c-97dc-ab4b215cf76b req-11911870-a18c-4cb9-b2fa-d7c5e151a2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051231 Apr 13 21:55:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 191/556] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:40 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0f8c6080-c83a-41b0-a8ba-c1f156200e00 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad3eb0>, body: {"keypair": {"name": "tempest-keypair-938295147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZc162tVythJhaJKRScqNIf+KMZxBjwe1ZrmXTBaQ3UKcFvBbLYWcAWzW2akMkMDvhbMf7BPoc9Gk1B4keTA03dVAmolivOo4U4/bjoKaWU2eORcyTrFfFocUk/JK/A2Q=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:40 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0f8c6080-c83a-41b0-a8ba-c1f156200e00 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:55:40 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0f8c6080-c83a-41b0-a8ba-c1f156200e00 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:55:40 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0f8c6080-c83a-41b0-a8ba-c1f156200e00 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.041590 Apr 13 21:55:40 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 183/557] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 21:55:40 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "name": "network-vif-plugged", "status": "completed", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] Creating event network-vif-plugged:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:55:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-7e7524e2-494f-403c-b720-9b4a45617211 req-43da7985-031c-4c17-a374-0da2e2b92017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036230 Apr 13 21:55:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 184/558] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-478774448", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88d8592d-4fff-4951-a1b8-140984c24696"}], "security_groups": [{"name": "tempest-securitygroup--1584757954"}], "key_name": "tempest-keypair-938295147", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'flavor' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] validate_networks() for [('88d8592d-4fff-4951-a1b8-140984c24696', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:55:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9ec98dcb-f7e2-4427-b24d-fb3fe14e69d3 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/action" status: 200 len: 32 microversion: 2.1 time: 0.160576 Apr 13 21:55:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 184/559] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:55:42 2023] POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-56503d3d-6c6f-4db8-b4cd-0a042a9caedb tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1722 microversion: 2.1 time: 0.145952 Apr 13 21:55:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 185/560] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:42 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:55:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:55:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7027e3a2-b4e7-4cfd-bb48-688152360846 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.627629 Apr 13 21:55:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 192/561] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:55:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-afaa2465-80fa-4724-8ddf-8e6453c0c616 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-afaa2465-80fa-4724-8ddf-8e6453c0c616 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-afaa2465-80fa-4724-8ddf-8e6453c0c616 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-afaa2465-80fa-4724-8ddf-8e6453c0c616 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 200 len: 1234 microversion: 2.1 time: 0.074924 Apr 13 21:55:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 185/562] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:55:42 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 21:55:44 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}, {"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Creating event network-vif-unplugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:55:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:55:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d4a67568-e487-42e5-bafc-ebe670141179 req-59f3a5c2-cd0c-4642-a083-4c29a4d106b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.043166 Apr 13 21:55:44 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 186/563] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:44 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-46152a48-ca9f-4d41-bf33-a151d0c95e9b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180/action" status: 202 len: 0 microversion: 2.87 time: 0.096083 Apr 13 21:55:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 193/564] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:55:45 2023] POST /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:45 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:55:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ca89988a-3a88-4d58-9cfc-d7aa5fbf6ea6 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1763 microversion: 2.87 time: 0.760996 Apr 13 21:55:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 186/565] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:55:45 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1763 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:55:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-5a6f242c-7cd3-4024-a6e8-a9fd40d48d47 req-d5a338ff-eb67-47e1-acc0-3c240fc31b46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043702 Apr 13 21:55:46 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 187/566] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] Creating event network-changed:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:55:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-be4a21a0-4fc8-4a7d-a92b-c899e9e45d9b req-a169815b-217c-47f5-b264-a7d8ed122d6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032685 Apr 13 21:55:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 194/567] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}, {"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-unplugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}, {"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:55:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Creating event network-vif-unplugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:55:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:55:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d8ba55dc-d0ad-49e4-86d8-b9aa442efbf5 req-b65dddd6-350e-4f42-a799-9cab71893a01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.059871 Apr 13 21:55:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 187/568] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "name": "network-vif-plugged", "status": "completed", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] Creating event network-vif-plugged:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:55:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-54f29e05-6cda-493b-8355-44d522b355b9 req-85f84c43-d8af-449e-8659-43b086c4cfce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031828 Apr 13 21:55:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 188/569] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:55:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3dbb8430-4aaa-4406-805e-088e2f56b604 req-0bf54581-6b80-4281-9c14-1c6213c504cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032743 Apr 13 21:55:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 195/570] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "name": "network-vif-plugged", "status": "completed", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] Creating event network-vif-plugged:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:55:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-db2a4cf1-8b08-4331-81eb-78247c96eba8 req-4928ce3e-1524-4c17-a63a-ffb383b1be74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029871 Apr 13 21:55:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 188/571] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:55:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:55:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:55:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:55:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:55:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 21:55:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-60a20664-c75c-4815-a128-eb2ceeb8344d req-7f4e8d7b-0a94-41ac-87e1-19c6d92e2e52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042793 Apr 13 21:55:52 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 189/572] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:55:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:56:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e340845b-16ff-4ed7-ac31-3c22f076b122 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45" status: 204 len: 0 microversion: 2.1 time: 0.127021 Apr 13 21:56:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 196/573] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:56:00 2023] DELETE /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1beee132-859e-4fec-b7c7-a342ec3c484f tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45" status: 200 len: 1490 microversion: 2.1 time: 0.241340 Apr 13 21:56:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 189/574] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:00 2023] GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 => generated 1490 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "name": "network-vif-unplugged", "status": "completed", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:00 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=33 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] Creating event network-vif-unplugged:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:56:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-8d22b19e-1a0c-4e41-91e4-347404b16cd1 req-7ba9c6f9-78a3-46f0-aebe-baf6979338be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101867 Apr 13 21:56:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 190/575] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1f8c4d13-7591-4947-a7db-6e49132f65d4 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044233 Apr 13 21:56:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 197/576] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:56:01 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dc2baaa1-a6ad-41d9-8b47-d9cc2f9acdef tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1678 microversion: 2.1 time: 0.230174 Apr 13 21:56:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 190/577] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:01 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-fee9a0a1-0a66-41b2-8f49-d23bf6191c37 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1678 microversion: 2.1 time: 0.150436 Apr 13 21:56:01 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 191/578] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:01 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "name": "network-vif-deleted", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] Creating event network-vif-deleted:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:56:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b94b7f17-edbb-45a1-af6b-cbbdfd4e37da req-60be27f8-d1d1-4f1e-a902-9ce0cf550776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037708 Apr 13 21:56:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 198/579] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:02 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-47412c98-f57e-4640-9020-12f841fee091 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1678 microversion: 2.1 time: 0.180613 Apr 13 21:56:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 191/580] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:01 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3489f51-3982-4ddd-9a38-fde0b31e5b45", "name": "network-vif-plugged", "status": "completed", "tag": "0dee1237-d171-40d9-ab20-6744df05223b"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:02 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] Creating event network-vif-plugged:0dee1237-d171-40d9-ab20-6744df05223b for instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 on user Apr 13 21:56:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-29822c6c-c6e4-4ba4-9d3f-16b5e11b0238 req-c82f05c4-a988-4a97-8521-9257dd31dbb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Apr 13 21:56:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 192/581] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:06 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fdad5ab3-2974-488c-942e-161e3234589a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 200 len: 1380 microversion: 2.1 time: 0.138083 Apr 13 21:56:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 199/582] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:06 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 1380 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:24 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1740be3f-9aea-40f5-b290-ec6ad851426e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 200 len: 1536 microversion: 2.1 time: 0.223555 Apr 13 21:56:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 192/583] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:24 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 1536 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=5 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=9 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cbfad36-b015-4d34-898a-ad20a4ff1df8"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:26 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:26 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-638005a5-b16e-46b1-8621-429b4847ea63 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.428214 Apr 13 21:56:26 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 193/584] 10.0.0.210 () {66 vars in 1441 bytes} [Thu Apr 13 21:56:26 2023] POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments => generated 188 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2b09c704-e77f-4bc3-b303-5a5293101d8a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments/4cbfad36-b015-4d34-898a-ad20a4ff1df8" status: 202 len: 0 microversion: 2.20 time: 0.247520 Apr 13 21:56:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 200/585] 10.0.0.210 () {64 vars in 1534 bytes} [Thu Apr 13 21:56:26 2023] DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments/4cbfad36-b015-4d34-898a-ad20a4ff1df8 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61663) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 21:56:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-df00a41f-05c9-4109-847b-9a3cf53aef03 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/action" status: 202 len: 0 microversion: 2.20 time: 0.116328 Apr 13 21:56:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 193/586] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:56:27 2023] POST /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f7996fa6-00fe-4157-ac47-fc8a0fee61ee tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1660 microversion: 2.20 time: 0.158195 Apr 13 21:56:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 194/587] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:56:27 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1660 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-944999147"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:28 user devstack@n-api.service[61664]: INFO nova.network.security_group_api [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Removing security group a34294e1-9f54-43e8-82c3-0e04985c247e from port 0150fcfb-793e-4d51-966c-c30195a9802f Apr 13 21:56:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-789f77d9-16f4-4a77-a3f5-c6d6054f14c7 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action" status: 202 len: 0 microversion: 2.1 time: 0.559541 Apr 13 21:56:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 201/588] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:56:28 2023] POST /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:56:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] Creating event network-changed:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:56:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8bfca00a-c6ba-4166-b400-5d29bc21eafd req-c3037a69-a4fa-4dcc-b993-1f45d9db4a77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031739 Apr 13 21:56:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 194/589] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] Creating event network-changed:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:56:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-b3865c9e-c73f-4493-ad60-9456538bbaa7 req-f8fa17ba-4f82-46a6-8d70-0c779efc8412 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032524 Apr 13 21:56:29 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 195/590] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:30 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lazy-loading 'services' on Instance uuid 03554793-01dd-4629-97c7-b640f5934639 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:56:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-28369fca-bc5c-4838-8ec3-a80d1628593e tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments/95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4" status: 202 len: 0 microversion: 2.1 time: 0.201034 Apr 13 21:56:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 202/591] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:56:30 2023] DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments/95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:30 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:30 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-83b64631-f323-4018-a212-61b86bad6189 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Apr 13 21:56:30 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 195/592] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:56:30 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:56:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:31 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] Creating event network-changed:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:56:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-009b4e31-ca0f-47fc-83a6-0ea32b139981 req-3eca514f-81a7-4885-bff1-9b420a65e875 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059205 Apr 13 21:56:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 196/593] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:33 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d6a8f53e-1eae-4fd9-af9e-8e3b6210aea5 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1702 microversion: 2.1 time: 0.478362 Apr 13 21:56:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 203/594] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:32 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1702 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-16f9c2ac-3fda-4bdd-b1c3-314cafe51033 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 200 len: 1544 microversion: 2.1 time: 0.199560 Apr 13 21:56:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 196/595] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:32 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:56:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4f6f616e-fa43-4b5e-bd8b-0960433dc717 req-4b05d765-bec5-4251-82ae-85f1008f9b2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032762 Apr 13 21:56:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 204/596] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:36 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a7ae4a50-c0e5-40bc-a624-47b3fb374259 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1769 microversion: 2.87 time: 0.172817 Apr 13 21:56:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 197/597] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:56:36 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1769 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:56:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:56:38 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-377139eb-7bc4-4526-ae63-835a94e81873 req-c239ba5c-0346-405e-ab38-8ca0929182d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044217 Apr 13 21:56:38 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 197/598] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: a3489f51-3982-4ddd-9a38-fde0b31e5b45] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] HTTP exception thrown: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Request method failure captured: Apr 13 21:56:50 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 HTTP/1.1 Apr 13 21:56:50 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:56:50 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:56:50 user devstack@n-api.service[61664]: Connection: close Apr 13 21:56:50 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:56:50 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:56:50 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:56:50 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:56:50 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHn-Ioy9dR9fl7Xco8TE619KfgzY-HBxDc37AhKMBaBdI7ogPRnu06A8KyPFTFWPcX9mCfE-YylodXwnkCpJv-GoU41mihkOZgBJJ3jMRYR6QxKUOS0JBUyYbCLM3puNmCnhEkQ9H75mrx0Rd_vJDAr0WnARDO4Q3W12_UsO8IhFF5w Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Project-Id: efd2e9bf0c5345f6bd3f030fb9f55e03 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesActionsTest-1838938247 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesActionsTest-1838938247 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Tenant-Id: efd2e9bf0c5345f6bd3f030fb9f55e03 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesActionsTest-1838938247 Apr 13 21:56:50 user devstack@n-api.service[61664]: X-User: tempest-VolumesActionsTest-1838938247-project-member Apr 13 21:56:50 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:56:50 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:56:50 user devstack@n-api.service[61664]: X-User-Id: 9fe6b951236f4a96a2ac12a5dea4602a Apr 13 21:56:50 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesActionsTest-1838938247-project-member Apr 13 21:56:50 user devstack@n-api.service[61664]: method: > Apr 13 21:56:50 user devstack@n-api.service[61664]: exception: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. Apr 13 21:56:50 user devstack@n-api.service[61664]: action_args: {'id': 'a3489f51-3982-4ddd-9a38-fde0b31e5b45'} Apr 13 21:56:50 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. Apr 13 21:56:50 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:56:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Returning 404 to user: Instance a3489f51-3982-4ddd-9a38-fde0b31e5b45 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:56:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-80de5d1f-710a-45ff-8e67-1ec9e44c92d3 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45" status: 404 len: 111 microversion: 2.1 time: 0.039393 Apr 13 21:56:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 205/599] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:50 2023] GET /compute/v2.1/servers/a3489f51-3982-4ddd-9a38-fde0b31e5b45 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2002337095", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "dd758252-0db3-4d47-a231-c8a85e067e9b"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=12 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] validate_networks() for [('dd758252-0db3-4d47-a231-c8a85e067e9b', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting quotas for project efd2e9bf0c5345f6bd3f030fb9f55e03. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Getting quotas for user 9fe6b951236f4a96a2ac12a5dea4602a and project efd2e9bf0c5345f6bd3f030fb9f55e03. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:56:51 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:56:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3c5e7b12-c90c-4cb4-850b-c64345edf06e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.483781 Apr 13 21:56:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 198/600] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:56:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:56:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ed89b09e-a67a-40cc-a26d-471d7a92f28e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:56:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ed89b09e-a67a-40cc-a26d-471d7a92f28e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:56:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:56:51 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-ed89b09e-a67a-40cc-a26d-471d7a92f28e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:56:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ed89b09e-a67a-40cc-a26d-471d7a92f28e tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266" status: 200 len: 1208 microversion: 2.1 time: 0.076908 Apr 13 21:56:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 198/601] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:56:51 2023] GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 => generated 1208 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:56:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] Creating event network-changed:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:56:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-7c884532-6535-4289-893c-b60389d4415e req-14b2090b-564e-4570-87e4-c7c3e6d97419 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 Apr 13 21:56:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 206/602] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:56 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "name": "network-vif-plugged", "status": "completed", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] Creating event network-vif-plugged:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:56:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c721e3f4-b4c5-4ba5-bdf4-09c5ecd7ae62 req-17fcbc44-c29e-418e-b3b5-fdffb9a331f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028145 Apr 13 21:56:56 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 199/603] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:56:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "name": "network-vif-plugged", "status": "completed", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:56:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:56:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:56:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:56:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] Creating event network-vif-plugged:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:56:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ef6296fe-88b1-4f55-bd98-75505e8c2a44 req-7a584f7c-4ed2-43d2-8560-d0ac763f3538 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051503 Apr 13 21:56:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 199/604] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:04 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-20b00066-e215-4bdc-a988-2d59efc22b70 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1678 microversion: 2.1 time: 0.149543 Apr 13 21:57:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 207/605] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:04 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "026beb94-6220-4541-8c6b-3296ae986d4a"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-efcb114b-7d83-4234-a863-cac0a7988dfa tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297289 Apr 13 21:57:05 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 200/606] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:57:04 2023] POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7f7c01ac-99f1-4f95-b11e-be914c574aba tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 200 len: 1380 microversion: 2.1 time: 0.160152 Apr 13 21:57:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 200/607] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:06 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 1380 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a688eeb6-90f3-4a42-842c-8852be15ab24 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 200 len: 1380 microversion: 2.1 time: 0.161611 Apr 13 21:57:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 208/608] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:06 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 1380 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:57:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-144b5e14-c0ef-4327-ba0a-3ad4552af2a8 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 204 len: 0 microversion: 2.1 time: 0.148959 Apr 13 21:57:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 201/609] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:57:06 2023] DELETE /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a31f23ce-3950-4ccb-8942-f673595a4f90 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 200 len: 1386 microversion: 2.1 time: 0.243745 Apr 13 21:57:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 201/610] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:06 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 1386 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "name": "network-vif-unplugged", "status": "completed", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] Creating event network-vif-unplugged:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:57:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4b2cce06-8bc0-4712-bd8d-2ec7f505889b req-9048f3c1-8565-4c4a-bcb2-80dea448edbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040252 Apr 13 21:57:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 209/611] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "name": "network-vif-deleted", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] Creating event network-vif-deleted:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:57:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-3a3c84d3-70d0-46eb-8a1b-fc72169fa4a4 req-18ddb546-8875-474a-bb97-7bb70ef6ddf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060511 Apr 13 21:57:08 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 202/612] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f496e7-47db-4602-850e-0260d5858049", "name": "network-vif-plugged", "status": "completed", "tag": "7dd2a5c6-f76c-45f3-adf1-8e92fa15d479"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] Creating event network-vif-plugged:7dd2a5c6-f76c-45f3-adf1-8e92fa15d479 for instance 64f496e7-47db-4602-850e-0260d5858049 on user Apr 13 21:57:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-6c15f619-ea33-44ac-874d-c2b696687076 req-f0054e8b-7739-414d-8d7a-509441a744cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028263 Apr 13 21:57:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 202/613] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Old instance type m1.nano, new instance type m1.micro {{(pid=61664) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:57:12 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:57:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4d0f7ea1-21e7-4902-82fc-b3c08bf4333a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.294970 Apr 13 21:57:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 210/614] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:57:12 2023] POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:13 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:13 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9ad2d476-28f3-48d0-af8b-ab63e4f27bcd tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1733 microversion: 2.1 time: 0.162353 Apr 13 21:57:13 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 203/615] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:12 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-unplugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Creating event network-vif-unplugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:57:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61663) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:57:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a0e4a080-140a-408a-ad54-cdd2edfde8a9 req-76feae38-a3b0-4ce2-a2df-5e35da602019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044775 Apr 13 21:57:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 203/616] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:17 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-326ffe7d-d93b-41ff-a598-6848f6c6e822 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1705 microversion: 2.20 time: 0.154789 Apr 13 21:57:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 211/617] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:57:17 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1705 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:57:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:57:17 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:57:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-40175d6b-4d2b-470c-b297-39604f945133 req-1a197fb8-f86b-4433-b750-2220c7ecfd5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042202 Apr 13 21:57:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 204/618] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f819b789-7ea5-45bb-809c-4af33fea422f tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168792 Apr 13 21:57:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 204/619] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:57:20 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HTTP exception thrown: Instance 03554793-01dd-4629-97c7-b640f5934639 is not attached to volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Request method failure captured: Apr 13 21:57:20 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments/95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 HTTP/1.1 Apr 13 21:57:20 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:57:20 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:57:20 user devstack@n-api.service[61664]: Connection: close Apr 13 21:57:20 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:57:20 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:57:20 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:57:20 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:57:20 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHgynpojptmTe_sI87n3uk0HjCiZ-cPMfqC4MJbZ_WhjJ2nIJB8MwofuVQZz-QSzV13A63aoRSBQMsBlLFOsuxFM1Yw6ovXDFlWQbH8g7Qc4gdSkXQKOBS_CaDDcJ0eIPCSMq9v0fQg4-OjPB1JMXCVupa_I26GoO5ZyHszOn7fwfZU Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Project-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Tenant: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Tenant-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-User: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:57:20 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:57:20 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:57:20 user devstack@n-api.service[61664]: X-User-Id: 710e0446cf794e94b3ab29bb0d7e10d8 Apr 13 21:57:20 user devstack@n-api.service[61664]: X-User-Name: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:57:20 user devstack@n-api.service[61664]: method: > Apr 13 21:57:20 user devstack@n-api.service[61664]: exception: Instance 03554793-01dd-4629-97c7-b640f5934639 is not attached to volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 Apr 13 21:57:20 user devstack@n-api.service[61664]: action_args: {'server_id': '03554793-01dd-4629-97c7-b640f5934639', 'id': '95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4'} Apr 13 21:57:20 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4. Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03554793-01dd-4629-97c7-b640f5934639 is not attached to volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03554793-01dd-4629-97c7-b640f5934639 is not attached to volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 Apr 13 21:57:20 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Returning 404 to user: Instance 03554793-01dd-4629-97c7-b640f5934639 is not attached to volume 95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ee53d3a-0155-42c3-946d-be65fdf44cbd tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments/95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4" status: 404 len: 154 microversion: 2.1 time: 0.085167 Apr 13 21:57:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 212/620] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:57:20 2023] DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639/os-volume_attachments/95dd80dd-ecf8-4c2b-9fce-29c205bf7ac4 => generated 154 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:23 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:57:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-911e19cd-6a7f-474f-a9ad-924e31c7999a tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 204 len: 0 microversion: 2.1 time: 0.122403 Apr 13 21:57:23 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 205/621] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:57:23 2023] DELETE /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=17 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=27 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:23 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '710e0446cf794e94b3ab29bb0d7e10d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4e8c27ff7d4fa9a61e000c9d02c5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e539531e-772c-4144-ad3f-fd05f6eaec13 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 200 len: 1541 microversion: 2.1 time: 0.222028 Apr 13 21:57:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 205/622] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:23 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 1541 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-unplugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:23 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] Creating event network-vif-unplugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:57:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4fb0c151-7c53-4015-9320-6592edbe5b98 req-9d269b7a-731e-4367-b9f3-a207b3f8fb7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045429 Apr 13 21:57:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 213/623] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-41498302-cd3f-411a-ab3d-6ccd43535430 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.094277 Apr 13 21:57:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 206/624] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:57:25 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-interface => generated 282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-plugged", "status": "completed", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}, {"server_uuid": "03554793-01dd-4629-97c7-b640f5934639", "name": "network-vif-deleted", "tag": "0150fcfb-793e-4d51-966c-c30195a9802f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Creating event network-vif-plugged:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:57:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] Creating event network-vif-deleted:0150fcfb-793e-4d51-966c-c30195a9802f for instance 03554793-01dd-4629-97c7-b640f5934639 on user Apr 13 21:57:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8abd2822-231d-432e-a754-2c22fc0393d3 req-0ea3b5e8-7367-4464-ab3e-16c19c981dc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033279 Apr 13 21:57:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 206/625] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-88281d06-4cc0-4563-8832-e641d0d44c28 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/ips" status: 200 len: 102 microversion: 2.1 time: 0.042040 Apr 13 21:57:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 214/626] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:57:26 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/ips => generated 102 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:57:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:57:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-2955432c-12a2-4ccc-baba-26c1853f56ff req-a165541f-1703-47f9-b68f-201cbb4fc606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072364 Apr 13 21:57:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 207/627] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] Creating event network-changed:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:57:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-7f49bc52-9c00-4bd4-8a4d-cfc5c882a933 req-cdbe4220-ea1f-4e09-8498-ac48833bbf9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043892 Apr 13 21:57:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 207/628] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "974804e5-626d-4a7a-b7a7-1ef0655b28fc"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-19111e9c-bf28-470e-8d27-644ee0ae0071 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252429 Apr 13 21:57:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 215/629] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:57:28 2023] POST /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:57:29 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:57:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-49ae0b75-ea27-43a3-950c-3378c75ab8d0 req-e8e3f08d-de55-4ce8-8566-e568616fab6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050113 Apr 13 21:57:29 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 208/630] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1dbeef8c-c726-4978-b8fc-5e5474cc04c1 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.114679 Apr 13 21:57:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 208/631] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:57:33 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/os-interface => generated 282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HTTP exception thrown: Cannot 'detach_volume' instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 while it is in vm_state rescued Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Request method failure captured: Apr 13 21:57:33 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments/0a3bb043-64a5-42ac-afa3-e4f0896f84d4 HTTP/1.1 Apr 13 21:57:33 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:57:33 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:57:33 user devstack@n-api.service[61664]: Connection: close Apr 13 21:57:33 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:57:33 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:57:33 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:57:33 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:57:33 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfgINELovSYm__2wxLA9vmb6F19FIFzyHnsB8GCT5zmExK61RxLrWwm71efToqXOq8QYwameGwiiiBIMKv_GuEGgjCT49EWNFTanBBgJi9AWgBRw97_RIogVE9SaXGT6a2lMum3vUzYMiCPuLWMNfHmXWAQPO77p_Iul6EqMk65Hi8 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Project-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70e84a09a76a44eb830e575db4321224"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Tenant-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-User: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 21:57:33 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:57:33 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:57:33 user devstack@n-api.service[61664]: X-User-Id: e77459bc3fa8496da1a089c460e32ed2 Apr 13 21:57:33 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 21:57:33 user devstack@n-api.service[61664]: method: > Apr 13 21:57:33 user devstack@n-api.service[61664]: exception: Cannot 'detach_volume' instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 while it is in vm_state rescued Apr 13 21:57:33 user devstack@n-api.service[61664]: action_args: {'server_id': 'b87dfe1b-f651-436d-87b5-eb257ef1a6e8', 'id': '0a3bb043-64a5-42ac-afa3-e4f0896f84d4'} Apr 13 21:57:33 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 while it is in vm_state rescued Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 while it is in vm_state rescued Apr 13 21:57:33 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Returning 409 to user: Cannot 'detach_volume' instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 while it is in vm_state rescued {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-eae7a866-627b-41d4-ac52-d286c13e7bca tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments/0a3bb043-64a5-42ac-afa3-e4f0896f84d4" status: 409 len: 152 microversion: 2.1 time: 0.121783 Apr 13 21:57:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 216/632] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:57:33 2023] DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments/0a3bb043-64a5-42ac-afa3-e4f0896f84d4 => generated 152 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4d365445-c48a-4946-984e-a1bfae819dc4 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/action" status: 202 len: 0 microversion: 2.1 time: 0.083598 Apr 13 21:57:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 209/633] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:57:33 2023] POST /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2b91a81b-4ee6-4ed6-8d39-e0e3ea575c6a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1710 microversion: 2.1 time: 0.276167 Apr 13 21:57:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 209/634] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:33 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1710 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=33 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] Creating event network-vif-unplugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:57:34 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-ae291c38-d006-4b1c-bbe9-4786e89257fa req-2bced852-7242-46f3-af00-ddf5358636ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037156 Apr 13 21:57:34 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 217/635] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4363b9af-44bc-45d5-9a3e-cb90eea5b5e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/ips" status: 200 len: 108 microversion: 2.1 time: 0.036613 Apr 13 21:57:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 210/636] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:57:34 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "314899e4-f6f0-4aba-a3cb-60eca54e6808"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 21:57:34 user devstack@n-api.service[61663]: request: POST /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/os-volume_attachments HTTP/1.1 Apr 13 21:57:34 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:57:34 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:57:34 user devstack@n-api.service[61663]: Connection: close Apr 13 21:57:34 user devstack@n-api.service[61663]: Content-Length: 74 Apr 13 21:57:34 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:57:34 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:57:34 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:57:34 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 21:57:34 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:57:34 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:57:34 user devstack@n-api.service[61663]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 21:57:34 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 21:57:34 user devstack@n-api.service[61663]: Apr 13 21:57:34 user devstack@n-api.service[61663]: {"volumeAttachment": {"volumeId": "314899e4-f6f0-4aba-a3cb-60eca54e6808"}} Apr 13 21:57:34 user devstack@n-api.service[61663]: method: > Apr 13 21:57:34 user devstack@n-api.service[61663]: exception: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 Apr 13 21:57:34 user devstack@n-api.service[61663]: action_args: {'server_id': '9c729f61-da40-49d7-8f93-d9bbe30fa877', 'body': {'volumeAttachment': {'volumeId': '314899e4-f6f0-4aba-a3cb-60eca54e6808'}}} Apr 13 21:57:34 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 Apr 13 21:57:34 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 400 to user: Invalid volume: volume 314899e4-f6f0-4aba-a3cb-60eca54e6808 is already attached to instances: 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-29df7afc-a450-4cd5-aa57-029ecc7adf8b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112752 Apr 13 21:57:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 210/637] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:57:34 2023] POST /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:34 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:57:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-da068e46-b315-471f-b095-894e98b82c0a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 204 len: 0 microversion: 2.1 time: 0.122742 Apr 13 21:57:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 218/638] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:57:34 2023] DELETE /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:35 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-66c2435e-a988-46aa-9ca4-c92074087001 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 200 len: 1550 microversion: 2.1 time: 0.212370 Apr 13 21:57:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 211/639] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:35 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 1550 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "name": "network-vif-unplugged", "status": "completed", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] Creating event network-vif-unplugged:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:57:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9dd97fb3-c125-4d11-9938-97b437b4d7c8 req-30e9aa87-1335-4543-8cab-33c2d33c92b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035612 Apr 13 21:57:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 211/640] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-297643457", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "5f022439-52f7-4c06-a4f9-6943fddcd352"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:36 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] validate_networks() for [('5f022439-52f7-4c06-a4f9-6943fddcd352', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}, {"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Creating event network-changed:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:57:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-5dd91d04-d940-428c-9b3e-dee32113d77b req-c972c61f-9400-4edc-b2f9-026241ace38b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044607 Apr 13 21:57:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 212/641] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:36 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dc272ce3-bf1b-4d5e-b99d-cb707b563afe tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084663 Apr 13 21:57:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 212/642] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:57:36 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f370431e-d6be-4453-95c5-8fc2eab2445c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc" status: 200 len: 194 microversion: 2.1 time: 0.063058 Apr 13 21:57:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 213/643] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 21:57:36 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for user 0ab740920cac4befac62a72f7ce5a817 and project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:57:37 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:57:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "name": "network-vif-plugged", "status": "completed", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}, {"server_uuid": "9c729f61-da40-49d7-8f93-d9bbe30fa877", "name": "network-vif-deleted", "tag": "330b43f2-b324-4cbf-953e-7225711aa856"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-87393c0c-b094-40ae-8529-747b99a0c310 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.024653 Apr 13 21:57:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 219/644] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 21:57:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 13 21:57:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Creating event network-vif-plugged:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:57:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] Creating event network-vif-deleted:330b43f2-b324-4cbf-953e-7225711aa856 for instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 on user Apr 13 21:57:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8632dc65-e4c6-477a-95e0-8d457b75ea05 req-8a82ef8c-076a-4e1a-9817-62251fedfbd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040840 Apr 13 21:57:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 213/645] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:37 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:37 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:37 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:37 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9c2b7d87-cfb7-4d66-b75b-ab8407e5867f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 200 len: 1394 microversion: 2.87 time: 0.111497 Apr 13 21:57:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 214/646] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:57:37 2023] GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 1394 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:57:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}, {"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:57:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:57:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-45fd0c46-d03f-42c9-91f6-700639c60860 req-9ca742c8-eff2-4ad1-96fd-f05ab980e96f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040807 Apr 13 21:57:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 220/647] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4732c9ce-0873-4c34-82bd-aee4d8b249f8"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7ca9f44c-a376-4844-b1b8-99c6aaf30343 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "POST /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287010 Apr 13 21:57:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 214/648] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 21:57:39 2023] POST /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] Creating event network-changed:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 21:57:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-f96fc715-ff29-448a-9cbb-0db8ffb66f5b req-58508cf5-7b4f-44c5-a1a9-ffa1060d2ccc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Apr 13 21:57:40 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 215/649] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:41 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-10e0912b-f8ec-48a6-86d0-014fc7900496 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266" status: 200 len: 1485 microversion: 2.1 time: 0.220836 Apr 13 21:57:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 221/650] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:41 2023] GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 => generated 1485 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "name": "network-vif-plugged", "status": "completed", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] Creating event network-vif-plugged:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 21:57:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-089b40ca-49f3-41fb-b72b-05fca878aef9 req-df487899-66e4-4823-b4a7-5c0a5d690ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048906 Apr 13 21:57:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 215/651] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:44 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "name": "network-vif-plugged", "status": "completed", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:44 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] Creating event network-vif-plugged:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 21:57:44 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-78d023d8-ba69-4453-9250-4d2d6515c8ff req-2f099dc1-b2c8-4baf-9ec3-1545e8ac55ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033674 Apr 13 21:57:44 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 216/652] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e123e3fa-980f-4aad-847b-325ba82d3582 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046503 Apr 13 21:57:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 222/653] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:57:47 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c4a6fd4f-fc10-401f-a9de-276c2094b5a1 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc" status: 200 len: 194 microversion: 2.1 time: 0.042683 Apr 13 21:57:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 216/654] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 21:57:47 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:47 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'services' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:57:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9530a78b-5b2c-48d4-8bae-9e880c1fadfb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc" status: 202 len: 0 microversion: 2.1 time: 0.169829 Apr 13 21:57:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 217/655] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:57:47 2023] DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/974804e5-626d-4a7a-b7a7-1ef0655b28fc => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c2f29a73-a0c9-4dbe-a432-17c9b1cc187c tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/4732c9ce-0873-4c34-82bd-aee4d8b249f8" status: 200 len: 194 microversion: 2.1 time: 0.045214 Apr 13 21:57:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 223/656] 10.0.0.210 () {62 vars in 1490 bytes} [Thu Apr 13 21:57:49 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/4732c9ce-0873-4c34-82bd-aee4d8b249f8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:49 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lazy-loading 'services' on Instance uuid 68dbaff0-73ca-4caa-bd4f-f97065df4409 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:57:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-24b94d36-d47d-4d88-8e53-d39efcc93a62 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/4732c9ce-0873-4c34-82bd-aee4d8b249f8" status: 202 len: 0 microversion: 2.1 time: 0.160890 Apr 13 21:57:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 217/657] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:57:49 2023] DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments/4732c9ce-0873-4c34-82bd-aee4d8b249f8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-57fae93a-eadb-46ef-aa0a-1c2a9d4a8af4 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041843 Apr 13 21:57:52 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 218/658] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:57:52 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0c4759a4-5646-4167-b0bd-08c7fd75c2f6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040653 Apr 13 21:57:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 224/659] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:57:52 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:57:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-62fa4ebb-d0f4-40d2-8662-0a648e050d2e tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 204 len: 0 microversion: 2.1 time: 0.120900 Apr 13 21:57:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 218/660] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:57:52 2023] DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60e4dadf9d9e41e6a91ee03a0cd50dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3605d609b52b431993bcea0798a77554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:57:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7ee1ade0-fcbf-479d-924c-1ef7bf61789a tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 200 len: 1660 microversion: 2.1 time: 0.342089 Apr 13 21:57:52 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 219/661] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:52 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 1660 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "name": "network-vif-unplugged", "status": "completed", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] Creating event network-vif-unplugged:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:57:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-55188c8e-2730-4f15-842d-6ffb0ab335d8 req-d155e926-876d-454d-9f40-1fce13d3b908 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035995 Apr 13 21:57:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 225/662] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "name": "network-vif-plugged", "status": "completed", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}, {"server_uuid": "68dbaff0-73ca-4caa-bd4f-f97065df4409", "name": "network-vif-deleted", "tag": "281f102d-de13-4548-a18c-3e452509c97c"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:55 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Creating event network-vif-plugged:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:57:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] Creating event network-vif-deleted:281f102d-de13-4548-a18c-3e452509c97c for instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 on user Apr 13 21:57:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f9be7e86-40da-4c68-9d75-81c06b229bc0 req-c54dd212-cb55-4301-b394-1a612d260f69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049079 Apr 13 21:57:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 219/663] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:57:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 21:57:57 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 HTTP/1.1 Apr 13 21:57:57 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:57:57 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:57:57 user devstack@n-api.service[61665]: Connection: close Apr 13 21:57:57 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:57:57 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:57:57 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:57:57 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:57:57 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 21:57:57 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61665]: method: > Apr 13 21:57:57 user devstack@n-api.service[61665]: exception: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61665]: action_args: {'id': '64f496e7-47db-4602-850e-0260d5858049'} Apr 13 21:57:57 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-97f73f16-3f79-4827-b230-09c8d7c317fb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 404 len: 111 microversion: 2.1 time: 0.032376 Apr 13 21:57:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 220/664] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:57 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 21:57:57 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 HTTP/1.1 Apr 13 21:57:57 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:57:57 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:57:57 user devstack@n-api.service[61664]: Connection: close Apr 13 21:57:57 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:57:57 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:57:57 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:57:57 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:57:57 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61664]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 21:57:57 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61664]: method: > Apr 13 21:57:57 user devstack@n-api.service[61664]: exception: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61664]: action_args: {'id': '64f496e7-47db-4602-850e-0260d5858049'} Apr 13 21:57:57 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-96853168-464a-4d0b-9695-32aaed96b015 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 404 len: 111 microversion: 2.1 time: 0.029540 Apr 13 21:57:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 226/665] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:57:57 2023] DELETE /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 64f496e7-47db-4602-850e-0260d5858049] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:57:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 21:57:57 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 HTTP/1.1 Apr 13 21:57:57 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:57:57 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:57:57 user devstack@n-api.service[61663]: Connection: close Apr 13 21:57:57 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:57:57 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:57:57 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:57:57 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:57:57 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:57:57 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:57:57 user devstack@n-api.service[61663]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 21:57:57 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 21:57:57 user devstack@n-api.service[61663]: method: > Apr 13 21:57:57 user devstack@n-api.service[61663]: exception: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61663]: action_args: {'id': '64f496e7-47db-4602-850e-0260d5858049'} Apr 13 21:57:57 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. Apr 13 21:57:57 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:57:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 64f496e7-47db-4602-850e-0260d5858049 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:57:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f5cf0eb7-d4fc-42b2-9270-f33a00b8830d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049" status: 404 len: 111 microversion: 2.1 time: 0.028101 Apr 13 21:57:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 220/666] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:57:57 2023] GET /compute/v2.1/servers/64f496e7-47db-4602-850e-0260d5858049 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:03 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-77f5def5-d101-46b6-a66e-3eda3ea1edd2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1732 microversion: 2.1 time: 0.163749 Apr 13 21:58:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 221/667] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:03 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-782768086", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "6eaa51d1-a9c7-4ca4-b76d-903304f71409", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 21:58:06 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 21:58:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 21:58:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6eaa51d1-a9c7-4ca4-b76d-903304f71409',volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 21:58:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-8e5f7d4f-f23f-44ea-afef-4dd15caba423 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.740777 Apr 13 21:58:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 227/668] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 21:58:06 2023] POST /compute/v2.1/servers => generated 378 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 21:58:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-532c27e2-d980-4961-8d8e-395c9eacbeed tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:07 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-532c27e2-d980-4961-8d8e-395c9eacbeed tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:07 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-532c27e2-d980-4961-8d8e-395c9eacbeed tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-532c27e2-d980-4961-8d8e-395c9eacbeed tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 200 len: 1065 microversion: 2.1 time: 0.066943 Apr 13 21:58:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 221/669] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:07 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 1065 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] Creating event network-changed:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 21:58:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-cad691d4-1df6-4a5a-84a3-4e4b6dc5578c req-6ebc77fb-fe42-467a-94cd-e483a22c79ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032867 Apr 13 21:58:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 222/670] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] [instance: 03554793-01dd-4629-97c7-b640f5934639] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] HTTP exception thrown: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Request method failure captured: Apr 13 21:58:13 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 HTTP/1.1 Apr 13 21:58:13 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:58:13 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:58:13 user devstack@n-api.service[61664]: Connection: close Apr 13 21:58:13 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:58:13 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:58:13 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:58:13 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:58:13 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHgynpojptmTe_sI87n3uk0HjCiZ-cPMfqC4MJbZ_WhjJ2nIJB8MwofuVQZz-QSzV13A63aoRSBQMsBlLFOsuxFM1Yw6ovXDFlWQbH8g7Qc4gdSkXQKOBS_CaDDcJ0eIPCSMq9v0fQg4-OjPB1JMXCVupa_I26GoO5ZyHszOn7fwfZU Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Project-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7d4e8c27ff7d4fa9a61e000c9d02c5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Tenant: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Tenant-Id: 7d4e8c27ff7d4fa9a61e000c9d02c5f4 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1800545339 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-User: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:58:13 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:58:13 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:58:13 user devstack@n-api.service[61664]: X-User-Id: 710e0446cf794e94b3ab29bb0d7e10d8 Apr 13 21:58:13 user devstack@n-api.service[61664]: X-User-Name: tempest-TestMinimumBasicScenario-1800545339-project-member Apr 13 21:58:13 user devstack@n-api.service[61664]: method: > Apr 13 21:58:13 user devstack@n-api.service[61664]: exception: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. Apr 13 21:58:13 user devstack@n-api.service[61664]: action_args: {'id': '03554793-01dd-4629-97c7-b640f5934639'} Apr 13 21:58:13 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. Apr 13 21:58:13 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Returning 404 to user: Instance 03554793-01dd-4629-97c7-b640f5934639 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-75941a6e-d243-4856-b38f-702816cdd7b8 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639" status: 404 len: 111 microversion: 2.1 time: 0.030028 Apr 13 21:58:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 228/671] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:13 2023] GET /compute/v2.1/servers/03554793-01dd-4629-97c7-b640f5934639 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-481e4c66-f875-498d-a2d8-404279b8a692 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] Calling method '.version_select at 0x7f4b3c96d090>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:13 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-481e4c66-f875-498d-a2d8-404279b8a692 tempest-TestMinimumBasicScenario-1800545339 tempest-TestMinimumBasicScenario-1800545339-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-636650613" status: 202 len: 0 microversion: 2.1 time: 0.024800 Apr 13 21:58:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 222/672] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 13 21:58:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-636650613 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:58:16 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "name": "network-vif-plugged", "status": "completed", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] Creating event network-vif-plugged:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 21:58:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0a52a449-22c1-4ac6-9d13-b427d02e9154 req-bd4e24e6-b8e4-419f-afaf-2326824f2cce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036762 Apr 13 21:58:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 223/673] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c5ffae51-e72a-4393-ad35-789611df6ed2 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046251 Apr 13 21:58:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 229/674] 10.0.0.210 () {64 vars in 1420 bytes} [Thu Apr 13 21:58:17 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:58:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-677bbf34-8630-44d2-93e7-ede5f5c24e45 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 204 len: 0 microversion: 2.20 time: 0.116834 Apr 13 21:58:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 223/675] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:58:17 2023] DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:18 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f151b673e3d47acb9c3ed9b9ecaf687', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c23bc3e8b14441b4622095502b5dae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-bb9cf2b1-b740-4e3d-b654-d56d20474763 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 200 len: 1711 microversion: 2.20 time: 0.163659 Apr 13 21:58:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 224/676] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:58:18 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 1711 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:58:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "name": "network-vif-plugged", "status": "completed", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] Creating event network-vif-plugged:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 21:58:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3d72d54b-1064-4cdc-ad87-074fba465233 req-15b1fc75-fc64-44e2-8ca7-5fad4c268b3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030372 Apr 13 21:58:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 230/677] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-unplugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}, {"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-plugged", "status": "completed", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Creating event network-vif-unplugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:58:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] Creating event network-vif-plugged:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:58:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-1525dc73-6052-41fc-8e19-3839ab5ec13c req-ca533031-a52a-41d3-a88e-b5f7b978ee45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.038713 Apr 13 21:58:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 224/678] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:22 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d1990a1-40ec-4c02-941f-813c22e8cd8f", "name": "network-vif-deleted", "tag": "596fdd61-68e0-4968-9d6a-e70d32a61ea1"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:22 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] Creating event network-vif-deleted:596fdd61-68e0-4968-9d6a-e70d32a61ea1 for instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f on user Apr 13 21:58:22 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-5958c634-f08d-448e-ad08-67ad4335ccfc req-e16d6c7b-426d-4fda-9f0f-10cdf1e7e1ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034594 Apr 13 21:58:22 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 225/679] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:23 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-de53e491-0e42-46e0-b0c9-fa90a8e5fb9b tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1716 microversion: 2.1 time: 0.154611 Apr 13 21:58:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 231/680] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:23 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 21:58:25 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 HTTP/1.1 Apr 13 21:58:25 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:58:25 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:58:25 user devstack@n-api.service[61663]: Connection: close Apr 13 21:58:25 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:58:25 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:58:25 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:58:25 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:58:25 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 21:58:25 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:58:25 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:58:25 user devstack@n-api.service[61663]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 21:58:25 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 21:58:25 user devstack@n-api.service[61663]: method: > Apr 13 21:58:25 user devstack@n-api.service[61663]: exception: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 21:58:25 user devstack@n-api.service[61663]: action_args: {'id': '9c729f61-da40-49d7-8f93-d9bbe30fa877'} Apr 13 21:58:25 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 21:58:25 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8209fa0a-666d-41cf-951e-1e42232dc106 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 404 len: 111 microversion: 2.1 time: 0.035915 Apr 13 21:58:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 225/681] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:25 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4225368c-6fe9-4c56-951f-125cc7d1d0c0 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '.version_select at 0x7f4b3cad83a0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4225368c-6fe9-4c56-951f-125cc7d1d0c0 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938295147" status: 202 len: 0 microversion: 2.1 time: 0.034835 Apr 13 21:58:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 226/682] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 21:58:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938295147 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:26 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'services' on Instance uuid 78b584a2-7dbc-4793-9d93-37897f9a24b1 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:58:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f08a1124-dfb0-42fb-b43f-0675341ce1fa tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments/314899e4-f6f0-4aba-a3cb-60eca54e6808" status: 202 len: 0 microversion: 2.1 time: 0.180286 Apr 13 21:58:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 232/683] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:58:26 2023] DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments/314899e4-f6f0-4aba-a3cb-60eca54e6808 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:26 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-db7d190b-a4c0-4fe6-ae05-a569a571e95e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Apr 13 21:58:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 226/684] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:58:26 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-52cdb6a1-9194-4bf0-8fe2-f3b23a4d3548 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 200 len: 1691 microversion: 2.87 time: 0.216054 Apr 13 21:58:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 227/685] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:58:27 2023] GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:58:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-64ba6b05-08da-4fe2-b20b-96944926a491 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266" status: 204 len: 0 microversion: 2.1 time: 0.121343 Apr 13 21:58:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 233/686] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:58:42 2023] DELETE /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "name": "network-vif-unplugged", "status": "completed", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=25 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] Creating event network-vif-unplugged:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:58:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-daf5caa9-1b12-435d-85ae-5e354c465e05 req-80ed22c0-27f2-43de-bb61-f1924b150d00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038794 Apr 13 21:58:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 228/687] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:42 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fe6b951236f4a96a2ac12a5dea4602a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd2e9bf0c5345f6bd3f030fb9f55e03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-29d3f201-5aa8-4005-9b9c-16e447503493 tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266" status: 200 len: 1491 microversion: 2.1 time: 0.274585 Apr 13 21:58:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 227/688] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:42 2023] GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 => generated 1491 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:58:42 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 HTTP/1.1 Apr 13 21:58:42 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:58:42 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:58:42 user devstack@n-api.service[61664]: Connection: close Apr 13 21:58:42 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:58:42 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:58:42 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:58:42 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:58:42 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:42 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:58:42 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:58:42 user devstack@n-api.service[61664]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:58:42 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:42 user devstack@n-api.service[61664]: method: > Apr 13 21:58:42 user devstack@n-api.service[61664]: exception: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:42 user devstack@n-api.service[61664]: action_args: {'id': '68dbaff0-73ca-4caa-bd4f-f97065df4409'} Apr 13 21:58:42 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:42 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:42 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:42 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-644eb681-e1f4-4dcb-a751-b240bf11cdeb tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 404 len: 111 microversion: 2.1 time: 0.037106 Apr 13 21:58:42 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 234/689] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:42 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-26875f23-30d7-4823-a66d-bb8e3cd29905 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '.version_select at 0x7f4b3cb83130>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-26875f23-30d7-4823-a66d-bb8e3cd29905 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585186331" status: 202 len: 0 microversion: 2.1 time: 0.029804 Apr 13 21:58:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 229/690] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 21:58:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585186331 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:58:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "name": "network-vif-deleted", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] Creating event network-vif-deleted:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:58:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e2f5cab7-eb73-4c40-abae-e46bbd868c7a req-f1ecba04-41cc-44c0-aa53-8c3cf0d8a9d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Apr 13 21:58:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 228/691] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef8a447a-cdcd-4a56-ad53-abe6d9951266", "name": "network-vif-plugged", "status": "completed", "tag": "24413127-af01-4371-9639-0f41979b91fb"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] Creating event network-vif-plugged:24413127-af01-4371-9639-0f41979b91fb for instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 on user Apr 13 21:58:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-85295084-3c66-4039-9f34-50e8d73d6e3f req-115fbd79-a8df-439a-9202-c2ae6d385e2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030374 Apr 13 21:58:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 235/692] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:58:49 user devstack@n-api.service[61665]: request: DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 HTTP/1.1 Apr 13 21:58:49 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:58:49 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:58:49 user devstack@n-api.service[61665]: Connection: close Apr 13 21:58:49 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:58:49 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:58:49 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:58:49 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:58:49 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:49 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:58:49 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:58:49 user devstack@n-api.service[61665]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:58:49 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:49 user devstack@n-api.service[61665]: method: > Apr 13 21:58:49 user devstack@n-api.service[61665]: exception: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61665]: action_args: {'id': '68dbaff0-73ca-4caa-bd4f-f97065df4409'} Apr 13 21:58:49 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-cf12ff0b-7b26-4e86-9cb9-dcdb59134ec6 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 404 len: 111 microversion: 2.1 time: 0.036371 Apr 13 21:58:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 230/693] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:58:49 2023] DELETE /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: 68dbaff0-73ca-4caa-bd4f-f97065df4409] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:58:49 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 HTTP/1.1 Apr 13 21:58:49 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:58:49 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:58:49 user devstack@n-api.service[61663]: Connection: close Apr 13 21:58:49 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:58:49 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:58:49 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:58:49 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:58:49 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:49 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:58:49 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:58:49 user devstack@n-api.service[61663]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:58:49 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:49 user devstack@n-api.service[61663]: method: > Apr 13 21:58:49 user devstack@n-api.service[61663]: exception: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61663]: action_args: {'id': '68dbaff0-73ca-4caa-bd4f-f97065df4409'} Apr 13 21:58:49 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. Apr 13 21:58:49 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:58:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance 68dbaff0-73ca-4caa-bd4f-f97065df4409 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f9191908-41ef-4a9b-b25e-93bfbf9ac8e0 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409" status: 404 len: 111 microversion: 2.1 time: 0.029910 Apr 13 21:58:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 229/694] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:49 2023] GET /compute/v2.1/servers/68dbaff0-73ca-4caa-bd4f-f97065df4409 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:58:51 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 HTTP/1.1 Apr 13 21:58:51 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:58:51 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:58:51 user devstack@n-api.service[61664]: Connection: close Apr 13 21:58:51 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:58:51 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:58:51 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:58:51 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:58:51 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:51 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:58:51 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:58:51 user devstack@n-api.service[61664]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:58:51 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:51 user devstack@n-api.service[61664]: method: > Apr 13 21:58:51 user devstack@n-api.service[61664]: exception: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:51 user devstack@n-api.service[61664]: action_args: {'id': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'} Apr 13 21:58:51 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:51 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:58:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7b33aa09-9a1b-4ea7-b7da-c0c5e3205be2 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 404 len: 111 microversion: 2.1 time: 0.037400 Apr 13 21:58:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 236/695] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:58:51 2023] DELETE /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] [instance: ddc7aa71-95a1-4a3c-a5c1-746b86a011c2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] HTTP exception thrown: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Request method failure captured: Apr 13 21:58:52 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 HTTP/1.1 Apr 13 21:58:52 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:58:52 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:58:52 user devstack@n-api.service[61665]: Connection: close Apr 13 21:58:52 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:58:52 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:58:52 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:58:52 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:58:52 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfaKnuVSBQLqATgBZyAd8zkwZube1Rlp91fOIGN2aFYJYl24qttVWmxzqjRJqBBHc4sDDXH1JH39rqxbMrBehPJNIYBcUy3lWrXIlYD7BQcr20W8z4aNalpdU2q5Q7l-JXVD6lrsjyXWWRG9sM4KLFlijtTLG9W_xAb57txTAC8zck Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Project-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3605d609b52b431993bcea0798a77554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3605d609b52b431993bcea0798a77554"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Tenant-Id: 3605d609b52b431993bcea0798a77554 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeTestJSON-249879422 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:52 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:58:52 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:58:52 user devstack@n-api.service[61665]: X-User-Id: 60e4dadf9d9e41e6a91ee03a0cd50dc3 Apr 13 21:58:52 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeTestJSON-249879422-project-member Apr 13 21:58:52 user devstack@n-api.service[61665]: method: > Apr 13 21:58:52 user devstack@n-api.service[61665]: exception: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:52 user devstack@n-api.service[61665]: action_args: {'id': 'ddc7aa71-95a1-4a3c-a5c1-746b86a011c2'} Apr 13 21:58:52 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. Apr 13 21:58:52 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:58:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] Returning 404 to user: Instance ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:58:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-39b60222-728a-43cd-906e-2e2179fc95b5 tempest-AttachVolumeTestJSON-249879422 tempest-AttachVolumeTestJSON-249879422-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2" status: 404 len: 111 microversion: 2.1 time: 0.027295 Apr 13 21:58:52 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:51 2023] GET /compute/v2.1/servers/ddc7aa71-95a1-4a3c-a5c1-746b86a011c2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:58:57 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:58:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-452ed100-5876-4432-b7c6-0b9f9c4a7187 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 200 len: 1393 microversion: 2.1 time: 0.150789 Apr 13 21:58:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 230/697] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:58:57 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:58:58 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7ae1c94f-a5aa-4044-b430-6e8b6f44cd7e tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c9cff40>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:58:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7ae1c94f-a5aa-4044-b430-6e8b6f44cd7e tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65396028-a10a-4b25-8419-a767a4d9b563" status: 200 len: 350 microversion: 2.1 time: 0.052464 Apr 13 21:58:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 237/698] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:58:58 2023] GET /compute/v2.1/os-volumes/65396028-a10a-4b25-8419-a767a4d9b563 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:00 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4745be47-5bb7-4109-8f1e-98fe2a0f9cbf tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3cb83250>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4745be47-5bb7-4109-8f1e-98fe2a0f9cbf tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7823af97-9bc2-4399-847e-632104a7e901" status: 200 len: 350 microversion: 2.1 time: 0.055272 Apr 13 21:59:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:00 2023] GET /compute/v2.1/os-volumes/7823af97-9bc2-4399-847e-632104a7e901 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-afa5239b-5b7f-40df-a4a9-c8d049fdd9eb tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3cad3880>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-afa5239b-5b7f-40df-a4a9-c8d049fdd9eb tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f7b0bebd-c760-4aa0-81e7-010f120e0e0d" status: 200 len: 351 microversion: 2.1 time: 0.056324 Apr 13 21:59:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 231/700] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:02 2023] GET /compute/v2.1/os-volumes/f7b0bebd-c760-4aa0-81e7-010f120e0e0d => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:02 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:02 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-775c8f29-04e4-4616-8ea3-f97ac06bf64a tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c8e9c60>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-775c8f29-04e4-4616-8ea3-f97ac06bf64a tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087505 Apr 13 21:59:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 238/701] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 21:59:02 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-749ad7a4-1ec5-42cc-a877-7dd62193cc3b tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c9caa70>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:02 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-749ad7a4-1ec5-42cc-a877-7dd62193cc3b tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101248 Apr 13 21:59:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 233/702] 10.0.0.210 () {62 vars in 1226 bytes} [Thu Apr 13 21:59:02 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-550ab853-3441-4461-996f-42310f35eae8 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c96d3f0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-550ab853-3441-4461-996f-42310f35eae8 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.106907 Apr 13 21:59:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 232/703] 10.0.0.210 () {62 vars in 1211 bytes} [Thu Apr 13 21:59:02 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-75a5e976-a03c-4210-8488-326c9eaead5a tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c8757e0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-75a5e976-a03c-4210-8488-326c9eaead5a tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.079105 Apr 13 21:59:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 239/704] 10.0.0.210 () {62 vars in 1244 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-af159fce-5ab9-4728-a6ee-8763498a49c6 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c9ca950>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-af159fce-5ab9-4728-a6ee-8763498a49c6 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.094163 Apr 13 21:59:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1247 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47b7b5c2-6dac-40d9-957c-aa3aac38478d tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3cad1630>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-47b7b5c2-6dac-40d9-957c-aa3aac38478d tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091760 Apr 13 21:59:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 233/706] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-819773b8-22f0-4b3f-8ed7-440e440a616b tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c9cb640>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1df78589-a26e-44d4-b75c-ee984c446d3e tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action" status: 202 len: 0 microversion: 2.1 time: 0.174662 Apr 13 21:59:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 240/707] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:59:03 2023] POST /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f8908440-6f74-4946-9bd5-9d31aa87c4cb tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1731 microversion: 2.1 time: 0.233855 Apr 13 21:59:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 234/708] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-819773b8-22f0-4b3f-8ed7-440e440a616b tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.456989 Apr 13 21:59:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 235/709] 10.0.0.210 () {62 vars in 1265 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dc26b36f-d2f3-486b-b1c6-63c26b0099c4 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] Calling method '.version_select at 0x7f4b3c7a12d0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-dc26b36f-d2f3-486b-b1c6-63c26b0099c4 tempest-VolumesTestJSON-1507587299 tempest-VolumesTestJSON-1507587299-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093260 Apr 13 21:59:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 241/710] 10.0.0.210 () {62 vars in 1232 bytes} [Thu Apr 13 21:59:03 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-unplugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Creating event network-vif-unplugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:59:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61663) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:59:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-cfd27d70-8e89-47f8-b188-509ff57c35e5 req-b350a842-8ab9-4cd1-9e06-0b46299e4d71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042256 Apr 13 21:59:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 235/711] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:59:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 21:59:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-79bd2625-2296-46fa-9f12-dfac214e7125 req-206e1c72-c02e-42cd-a807-93c44f573ce4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Apr 13 21:59:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 236/712] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:59:08 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f HTTP/1.1 Apr 13 21:59:08 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:59:08 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:59:08 user devstack@n-api.service[61664]: Connection: close Apr 13 21:59:08 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:59:08 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:59:08 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:59:08 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:59:08 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:08 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:08 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:59:08 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:59:08 user devstack@n-api.service[61664]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:59:08 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:08 user devstack@n-api.service[61664]: method: > Apr 13 21:59:08 user devstack@n-api.service[61664]: exception: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:08 user devstack@n-api.service[61664]: action_args: {'id': '2d1990a1-40ec-4c02-941f-813c22e8cd8f'} Apr 13 21:59:08 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:08 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b25856fa-2dc2-4f88-97c7-0ff984c1c4a9 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 404 len: 111 microversion: 2.20 time: 0.031552 Apr 13 21:59:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 242/713] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:59:08 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:59:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c6fe0ded-f1c3-4c44-bce9-7bb1f239a276 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '.version_select at 0x7f4b3cad3250>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c6fe0ded-f1c3-4c44-bce9-7bb1f239a276 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268128451" status: 204 len: 0 microversion: 2.20 time: 0.029844 Apr 13 21:59:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 236/714] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 13 21:59:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1268128451 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:59:12 user devstack@n-api.service[61665]: request: DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f HTTP/1.1 Apr 13 21:59:12 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:59:12 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:59:12 user devstack@n-api.service[61665]: Connection: close Apr 13 21:59:12 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:59:12 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:59:12 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:59:12 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:59:12 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:12 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:12 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:59:12 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:59:12 user devstack@n-api.service[61665]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:59:12 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:12 user devstack@n-api.service[61665]: method: > Apr 13 21:59:12 user devstack@n-api.service[61665]: exception: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61665]: action_args: {'id': '2d1990a1-40ec-4c02-941f-813c22e8cd8f'} Apr 13 21:59:12 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-013c1349-41c1-488e-ae15-a7de37ea9e14 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 404 len: 111 microversion: 2.20 time: 0.033429 Apr 13 21:59:12 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 237/715] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:59:12 2023] DELETE /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: 2d1990a1-40ec-4c02-941f-813c22e8cd8f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:59:12 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f HTTP/1.1 Apr 13 21:59:12 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:59:12 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:59:12 user devstack@n-api.service[61664]: Connection: close Apr 13 21:59:12 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:59:12 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:59:12 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:59:12 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:59:12 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:12 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:12 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:59:12 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:59:12 user devstack@n-api.service[61664]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:59:12 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:12 user devstack@n-api.service[61664]: method: > Apr 13 21:59:12 user devstack@n-api.service[61664]: exception: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61664]: action_args: {'id': '2d1990a1-40ec-4c02-941f-813c22e8cd8f'} Apr 13 21:59:12 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. Apr 13 21:59:12 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance 2d1990a1-40ec-4c02-941f-813c22e8cd8f could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9fdc361f-00e1-4288-ba7f-a6bdf7552991 tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f" status: 404 len: 111 microversion: 2.20 time: 0.029959 Apr 13 21:59:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 243/716] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:59:12 2023] GET /compute/v2.1/servers/2d1990a1-40ec-4c02-941f-813c22e8cd8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=26 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:59:15 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 HTTP/1.1 Apr 13 21:59:15 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:59:15 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:59:15 user devstack@n-api.service[61663]: Connection: close Apr 13 21:59:15 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:59:15 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:59:15 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:59:15 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:59:15 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:15 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:15 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:59:15 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:59:15 user devstack@n-api.service[61663]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:59:15 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:15 user devstack@n-api.service[61663]: method: > Apr 13 21:59:15 user devstack@n-api.service[61663]: exception: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61663]: action_args: {'id': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7'} Apr 13 21:59:15 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5b8b74e4-a578-4782-8736-aa89eb31fc1a tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 404 len: 111 microversion: 2.20 time: 0.036281 Apr 13 21:59:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 237/717] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 21:59:15 2023] DELETE /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] [instance: eaff33f4-c1f5-45c5-b54f-555d1c66e8c7] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] HTTP exception thrown: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Request method failure captured: Apr 13 21:59:15 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 HTTP/1.1 Apr 13 21:59:15 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:59:15 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:59:15 user devstack@n-api.service[61665]: Connection: close Apr 13 21:59:15 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:59:15 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:59:15 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:59:15 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:59:15 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfgXotgKIFDth-JgPX2_1CZMK7a5bxOcm1E53DuxO_fiLTBXOHP6d8UKLQJwsmiliL6IflCbyvU3QylCblfanK3oFf6r3agCc7PsGeC29INp7c-X3bdLjHQe2I84CyZABj9JqttfzOXA7MlKUi0BY8uB2ApcKgYkU6GDWDLY-0cGhc Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.20 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Project-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/73c23bc3e8b14441b4622095502b5dae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Tenant-Id: 73c23bc3e8b14441b4622095502b5dae Apr 13 21:59:15 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-710815470 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:15 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:59:15 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:59:15 user devstack@n-api.service[61665]: X-User-Id: 3f151b673e3d47acb9c3ed9b9ecaf687 Apr 13 21:59:15 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeShelveTestJSON-710815470-project-member Apr 13 21:59:15 user devstack@n-api.service[61665]: method: > Apr 13 21:59:15 user devstack@n-api.service[61665]: exception: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61665]: action_args: {'id': 'eaff33f4-c1f5-45c5-b54f-555d1c66e8c7'} Apr 13 21:59:15 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. Apr 13 21:59:15 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] Returning 404 to user: Instance eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f843c4cd-6797-4b8f-ac84-c8d3a8fc913f tempest-AttachVolumeShelveTestJSON-710815470 tempest-AttachVolumeShelveTestJSON-710815470-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7" status: 404 len: 111 microversion: 2.20 time: 0.030795 Apr 13 21:59:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 238/718] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:59:15 2023] GET /compute/v2.1/servers/eaff33f4-c1f5-45c5-b54f-555d1c66e8c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f07c4bf0-a3c5-40c0-9695-a4c85be5df1e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.254976 Apr 13 21:59:16 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 244/719] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:59:16 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1/os-volume_attachments => generated 25 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 21:59:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c21b76fd-7234-41a3-84dc-d4c6f234f369 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 204 len: 0 microversion: 2.1 time: 0.136539 Apr 13 21:59:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 238/720] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 21:59:16 2023] DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:17 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5cd37961-0503-4d86-84ed-cb6839141b0d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 200 len: 1669 microversion: 2.1 time: 0.266725 Apr 13 21:59:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 239/721] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:59:16 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 1669 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "name": "network-vif-unplugged", "status": "completed", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] Creating event network-vif-unplugged:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:59:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-4cc90494-50d4-4a14-acf8-c176aa2dab07 req-daf88f41-87e4-45bc-b763-5193a4bb101e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.347374 Apr 13 21:59:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 245/722] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:59:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "name": "network-vif-deleted", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] Creating event network-vif-deleted:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:59:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-be56ce21-bdd5-470f-b571-382cb4da9390 req-40784a67-aebb-4822-82d0-8c4f4a227585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036662 Apr 13 21:59:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 239/723] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b584a2-7dbc-4793-9d93-37897f9a24b1", "name": "network-vif-plugged", "status": "completed", "tag": "1d9d691f-bf56-4916-9d1d-422be2299247"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Creating event network-vif-plugged:1d9d691f-bf56-4916-9d1d-422be2299247 for instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 on user Apr 13 21:59:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:59:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 21:59:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-acf7c0c6-0efb-4e01-ba2b-d8df90b009e4 req-c2840ffb-0cdd-4f56-808c-31a890c16033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032472 Apr 13 21:59:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 240/724] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:19 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-62931c60-a4b5-438f-9bc8-4d75d5382ae5 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c7a2d40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-287444355"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-62931c60-a4b5-438f-9bc8-4d75d5382ae5 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.550364 Apr 13 21:59:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 246/725] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 13 21:59:21 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 552 msecs (HTTP/1.1 200) 10 headers in 447 bytes (2 switches on core 0) Apr 13 21:59:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-fb02941b-0894-421b-b582-06d98225f9af tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c96feb0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-fb02941b-0894-421b-b582-06d98225f9af tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 200 len: 344 microversion: 2.1 time: 0.064440 Apr 13 21:59:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 240/726] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:22 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4a21dcb3-a968-4b9f-9ec6-f08606e52f7a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9c96c0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4a21dcb3-a968-4b9f-9ec6-f08606e52f7a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 200 len: 345 microversion: 2.1 time: 0.062157 Apr 13 21:59:23 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 241/727] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:23 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-cf6db7af-4b98-489e-aa67-98f401a6a97e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c7a0af0>, body: {"snapshot": {"volume_id": "65683156-001f-4b96-b4a6-3713e5ffe668", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-117102051"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-cf6db7af-4b98-489e-aa67-98f401a6a97e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.173264 Apr 13 21:59:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 247/728] 10.0.0.210 () {64 vars in 1239 bytes} [Thu Apr 13 21:59:23 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:23 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c7e7ab6e-1a1e-4f61-a691-e1102e47910f tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3ca5b130>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:23 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c7e7ab6e-1a1e-4f61-a691-e1102e47910f tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 286 microversion: 2.1 time: 0.036885 Apr 13 21:59:23 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 241/729] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:23 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-36479e56-1ab6-43f1-9f01-9a02049eebbc tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9c8f70>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-36479e56-1ab6-43f1-9f01-9a02049eebbc tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043259 Apr 13 21:59:23 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 242/730] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 21:59:23 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6738d28c-b822-489f-a251-515769488b14 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c7a3010>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6738d28c-b822-489f-a251-515769488b14 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 286 microversion: 2.1 time: 0.034281 Apr 13 21:59:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 248/731] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:23 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a052a33f-31be-47a7-833f-ceca2e721176 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.102988 Apr 13 21:59:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 242/732] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 21:59:24 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:24 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-49420032-c123-4574-9be2-d1f81afeaa7c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3cad9d80>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:24 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-49420032-c123-4574-9be2-d1f81afeaa7c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 286 microversion: 2.1 time: 0.050671 Apr 13 21:59:24 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 243/733] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:24 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 286 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:25 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] Creating event network-changed:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:59:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-608c3445-12c9-4371-8a62-23f0cf942336 req-06f47a8d-7465-4b57-a08f-e748ef8cb304 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027296 Apr 13 21:59:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 249/734] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lazy-loading 'services' on Instance uuid b87dfe1b-f651-436d-87b5-eb257ef1a6e8 {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 21:59:25 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-ed798d5d-9e94-4f93-baf8-2e66fffb9886 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments/0a3bb043-64a5-42ac-afa3-e4f0896f84d4" status: 202 len: 0 microversion: 2.1 time: 0.157875 Apr 13 21:59:25 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 243/735] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 21:59:25 2023] DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments/0a3bb043-64a5-42ac-afa3-e4f0896f84d4 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-749f22c2-50f8-4820-a071-817fa8873979 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064663 Apr 13 21:59:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 244/736] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 21:59:25 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:25 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d05c2bf-1ee3-4b7b-918c-5050fe34ec47 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c7a0670>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:25 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5d05c2bf-1ee3-4b7b-918c-5050fe34ec47 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 287 microversion: 2.1 time: 0.046942 Apr 13 21:59:25 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 250/737] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:25 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:25 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-78b190e7-9747-4793-93b5-1632c352955a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3cad1750>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:26 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-78b190e7-9747-4793-93b5-1632c352955a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 202 len: 0 microversion: 2.1 time: 0.099096 Apr 13 21:59:26 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 244/738] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 13 21:59:25 2023] DELETE /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:59:26 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-53f80ce7-3afb-42cf-ac6a-aba4b05a3e24 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9c91b0>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:26 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-53f80ce7-3afb-42cf-ac6a-aba4b05a3e24 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 286 microversion: 2.1 time: 0.040164 Apr 13 21:59:26 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 245/739] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:26 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 21:59:27 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-15efef10-a645-4727-a015-505bd0e5c4d0 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9ccc10>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:27 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-15efef10-a645-4727-a015-505bd0e5c4d0 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 200 len: 286 microversion: 2.1 time: 0.040667 Apr 13 21:59:27 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 251/740] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:27 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] Creating event network-changed:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 21:59:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-17b3c89f-adea-4d4b-a21c-785f61f42a80 req-220ef6d2-086e-4b66-8ff1-07ce399fbd20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036625 Apr 13 21:59:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 245/741] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 21:59:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-612700080"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-67352bb5-918e-485a-9c6c-f4db6f587bd9 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9ce680>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-67352bb5-918e-485a-9c6c-f4db6f587bd9 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] HTTP exception thrown: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. Apr 13 21:59:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-67352bb5-918e-485a-9c6c-f4db6f587bd9 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Request method failure captured: Apr 13 21:59:28 user devstack@n-api.service[61664]: request: GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 HTTP/1.1 Apr 13 21:59:28 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:59:28 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:59:28 user devstack@n-api.service[61664]: Connection: close Apr 13 21:59:28 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:59:28 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:59:28 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:59:28 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:59:28 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHs5DQCw-fVVE7l7GPnUfjG6vWLJTxTWmTnlqw-myF_VwQhAlj0AF4GCHwwBo259h5VmBQ3rEatuQzlSWYozQ42xqrZi7uY_-ZDSDl2Z42S4W_XTWsyTDYpmzNkdjIa1eAJjPu22qcNHGSiYYKj2bJV7VNJauNlJHyBYBZuKoYCUfOk Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Project-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Tenant-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-User: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:28 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:59:28 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:59:28 user devstack@n-api.service[61664]: X-User-Id: 7161a5c2116149d98f1564b66a8eedb2 Apr 13 21:59:28 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:28 user devstack@n-api.service[61664]: method: Apr 13 21:59:28 user devstack@n-api.service[61664]: exception: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. Apr 13 21:59:28 user devstack@n-api.service[61664]: action_args: {'id': '92278604-eefc-4a67-ab78-b957c4fd6488'} Apr 13 21:59:28 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. (HTTP 404) (Request-ID: req-abd01e2e-b8ed-4f78-a694-b02e6b2ec6a2) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. Apr 13 21:59:28 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-67352bb5-918e-485a-9c6c-f4db6f587bd9 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Returning 404 to user: Snapshot 92278604-eefc-4a67-ab78-b957c4fd6488 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-67352bb5-918e-485a-9c6c-f4db6f587bd9 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488" status: 404 len: 111 microversion: 2.1 time: 0.036205 Apr 13 21:59:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 252/742] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 21:59:28 2023] GET /compute/v2.1/os-snapshots/92278604-eefc-4a67-ab78-b957c4fd6488 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:59:28 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1d59f9f5-2c9b-4519-a03b-bafd81ee067a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3cad2d40>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:28 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1d59f9f5-2c9b-4519-a03b-bafd81ee067a tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 202 len: 0 microversion: 2.1 time: 0.070112 Apr 13 21:59:28 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 246/743] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:59:28 2023] DELETE /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 21:59:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ba26d01-137a-45e9-a852-313709ecc024 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9cca60>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ba26d01-137a-45e9-a852-313709ecc024 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 200 len: 344 microversion: 2.1 time: 0.060131 Apr 13 21:59:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 253/744] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:28 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:28 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-487aa95e-91fb-44c6-9581-964280f6ed4f tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f/action" status: 202 len: 52 microversion: 2.87 time: 0.917094 Apr 13 21:59:28 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 246/745] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 21:59:27 2023] POST /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f/action => generated 52 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 13 21:59:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dc92f190-2bfa-474b-ac81-9c62617dd27e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9f2950>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dc92f190-2bfa-474b-ac81-9c62617dd27e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 200 len: 344 microversion: 2.1 time: 0.050959 Apr 13 21:59:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 247/746] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:29 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-72d74230-685c-4c9b-a1f0-87969671c57e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c7a3910>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-72d74230-685c-4c9b-a1f0-87969671c57e tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 200 len: 344 microversion: 2.1 time: 0.059119 Apr 13 21:59:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 254/747] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:30 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 21:59:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-649600f3-897f-49e4-ab70-0e8ca7d687d7 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c967130>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-649600f3-897f-49e4-ab70-0e8ca7d687d7 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] HTTP exception thrown: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-649600f3-897f-49e4-ab70-0e8ca7d687d7 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Request method failure captured: Apr 13 21:59:31 user devstack@n-api.service[61665]: request: GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 HTTP/1.1 Apr 13 21:59:31 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:59:31 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:59:31 user devstack@n-api.service[61665]: Connection: close Apr 13 21:59:31 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:59:31 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:59:31 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:59:31 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:59:31 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHs5DQCw-fVVE7l7GPnUfjG6vWLJTxTWmTnlqw-myF_VwQhAlj0AF4GCHwwBo259h5VmBQ3rEatuQzlSWYozQ42xqrZi7uY_-ZDSDl2Z42S4W_XTWsyTDYpmzNkdjIa1eAJjPu22qcNHGSiYYKj2bJV7VNJauNlJHyBYBZuKoYCUfOk Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Project-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Tenant-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-User: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61665]: X-User-Id: 7161a5c2116149d98f1564b66a8eedb2 Apr 13 21:59:31 user devstack@n-api.service[61665]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61665]: method: Apr 13 21:59:31 user devstack@n-api.service[61665]: exception: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61665]: action_args: {'id': '65683156-001f-4b96-b4a6-3713e5ffe668'} Apr 13 21:59:31 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. (HTTP 404) (Request-ID: req-2225ffb8-b86d-476c-8714-1d9699c55f5e) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-649600f3-897f-49e4-ab70-0e8ca7d687d7 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Returning 404 to user: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-649600f3-897f-49e4-ab70-0e8ca7d687d7 tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 404 len: 109 microversion: 2.1 time: 0.071478 Apr 13 21:59:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 247/748] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:31 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:59:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e6c81979-8491-4e84-bef1-9b564dba74ef tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c96feb0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-e6c81979-8491-4e84-bef1-9b564dba74ef tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] HTTP exception thrown: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e6c81979-8491-4e84-bef1-9b564dba74ef tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Request method failure captured: Apr 13 21:59:31 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 HTTP/1.1 Apr 13 21:59:31 user devstack@n-api.service[61663]: Accept: application/json Apr 13 21:59:31 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 21:59:31 user devstack@n-api.service[61663]: Connection: close Apr 13 21:59:31 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 21:59:31 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 21:59:31 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 21:59:31 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 21:59:31 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHs5DQCw-fVVE7l7GPnUfjG6vWLJTxTWmTnlqw-myF_VwQhAlj0AF4GCHwwBo259h5VmBQ3rEatuQzlSWYozQ42xqrZi7uY_-ZDSDl2Z42S4W_XTWsyTDYpmzNkdjIa1eAJjPu22qcNHGSiYYKj2bJV7VNJauNlJHyBYBZuKoYCUfOk Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Project-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Tenant-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-User: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61663]: X-User-Id: 7161a5c2116149d98f1564b66a8eedb2 Apr 13 21:59:31 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61663]: method: Apr 13 21:59:31 user devstack@n-api.service[61663]: exception: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61663]: action_args: {'id': '65683156-001f-4b96-b4a6-3713e5ffe668'} Apr 13 21:59:31 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. (HTTP 404) (Request-ID: req-542a6347-5dde-414c-888a-d0a2767d1bc0) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e6c81979-8491-4e84-bef1-9b564dba74ef tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Returning 404 to user: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e6c81979-8491-4e84-bef1-9b564dba74ef tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 404 len: 109 microversion: 2.1 time: 0.064135 Apr 13 21:59:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 248/749] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 21:59:31 2023] DELETE /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:59:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38bd0bf6-acc5-4fd1-9303-77fad3af904c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Calling method '.version_select at 0x7f4b3c9ce8c0>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-38bd0bf6-acc5-4fd1-9303-77fad3af904c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] HTTP exception thrown: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38bd0bf6-acc5-4fd1-9303-77fad3af904c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Request method failure captured: Apr 13 21:59:31 user devstack@n-api.service[61664]: request: GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 HTTP/1.1 Apr 13 21:59:31 user devstack@n-api.service[61664]: Accept: application/json Apr 13 21:59:31 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 21:59:31 user devstack@n-api.service[61664]: Connection: close Apr 13 21:59:31 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 21:59:31 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 21:59:31 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 21:59:31 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 21:59:31 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHs5DQCw-fVVE7l7GPnUfjG6vWLJTxTWmTnlqw-myF_VwQhAlj0AF4GCHwwBo259h5VmBQ3rEatuQzlSWYozQ42xqrZi7uY_-ZDSDl2Z42S4W_XTWsyTDYpmzNkdjIa1eAJjPu22qcNHGSiYYKj2bJV7VNJauNlJHyBYBZuKoYCUfOk Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Project-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/03a1013892da4e4fa6a869c751ef1426"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Tenant-Id: 03a1013892da4e4fa6a869c751ef1426 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-144534046 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-User: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 21:59:31 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 21:59:31 user devstack@n-api.service[61664]: X-User-Id: 7161a5c2116149d98f1564b66a8eedb2 Apr 13 21:59:31 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesSnapshotsTestJSON-144534046-project-member Apr 13 21:59:31 user devstack@n-api.service[61664]: method: Apr 13 21:59:31 user devstack@n-api.service[61664]: exception: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61664]: action_args: {'id': '65683156-001f-4b96-b4a6-3713e5ffe668'} Apr 13 21:59:31 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. (HTTP 404) (Request-ID: req-99566db5-524c-4740-98da-a3b0ab9ba60c) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. Apr 13 21:59:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 21:59:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-38bd0bf6-acc5-4fd1-9303-77fad3af904c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] Returning 404 to user: Volume 65683156-001f-4b96-b4a6-3713e5ffe668 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-38bd0bf6-acc5-4fd1-9303-77fad3af904c tempest-VolumesSnapshotsTestJSON-144534046 tempest-VolumesSnapshotsTestJSON-144534046-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668" status: 404 len: 109 microversion: 2.1 time: 0.105680 Apr 13 21:59:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 255/750] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 21:59:31 2023] GET /compute/v2.1/os-volumes/65683156-001f-4b96-b4a6-3713e5ffe668 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] [instance: ef8a447a-cdcd-4a56-ad53-abe6d9951266] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=15 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] HTTP exception thrown: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Request method failure captured: Apr 13 21:59:33 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 HTTP/1.1 Apr 13 21:59:33 user devstack@n-api.service[61665]: Accept: application/json Apr 13 21:59:33 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 21:59:33 user devstack@n-api.service[61665]: Connection: close Apr 13 21:59:33 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 21:59:33 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 21:59:33 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 21:59:33 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 21:59:33 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHn-Ioy9dR9fl7Xco8TE619KfgzY-HBxDc37AhKMBaBdI7ogPRnu06A8KyPFTFWPcX9mCfE-YylodXwnkCpJv-GoU41mihkOZgBJJ3jMRYR6QxKUOS0JBUyYbCLM3puNmCnhEkQ9H75mrx0Rd_vJDAr0WnARDO4Q3W12_UsO8IhFF5w Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Project-Id: efd2e9bf0c5345f6bd3f030fb9f55e03 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Project-Name: tempest-VolumesActionsTest-1838938247 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/efd2e9bf0c5345f6bd3f030fb9f55e03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Tenant: tempest-VolumesActionsTest-1838938247 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Tenant-Id: efd2e9bf0c5345f6bd3f030fb9f55e03 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-VolumesActionsTest-1838938247 Apr 13 21:59:33 user devstack@n-api.service[61665]: X-User: tempest-VolumesActionsTest-1838938247-project-member Apr 13 21:59:33 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 21:59:33 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 21:59:33 user devstack@n-api.service[61665]: X-User-Id: 9fe6b951236f4a96a2ac12a5dea4602a Apr 13 21:59:33 user devstack@n-api.service[61665]: X-User-Name: tempest-VolumesActionsTest-1838938247-project-member Apr 13 21:59:33 user devstack@n-api.service[61665]: method: > Apr 13 21:59:33 user devstack@n-api.service[61665]: exception: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. Apr 13 21:59:33 user devstack@n-api.service[61665]: action_args: {'id': 'ef8a447a-cdcd-4a56-ad53-abe6d9951266'} Apr 13 21:59:33 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. Apr 13 21:59:33 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 21:59:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] Returning 404 to user: Instance ef8a447a-cdcd-4a56-ad53-abe6d9951266 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 21:59:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-06a27fc0-3555-4b9e-a2e1-55489fa2586b tempest-VolumesActionsTest-1838938247 tempest-VolumesActionsTest-1838938247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266" status: 404 len: 111 microversion: 2.1 time: 0.401524 Apr 13 21:59:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 248/751] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:59:32 2023] GET /compute/v2.1/servers/ef8a447a-cdcd-4a56-ad53-abe6d9951266 => generated 111 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:35 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-dcc909d3-842a-4f70-9590-57ca35c33888 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 200 len: 1691 microversion: 2.87 time: 0.193387 Apr 13 21:59:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 249/752] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 21:59:35 2023] GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:54 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bcdb7cac-88c0-4a96-9235-5c3161ceb3b5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.209744 Apr 13 21:59:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 256/753] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:59:53 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:57 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 21:59:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ec0eadf9-3bf4-4bb4-9b64-ffb44a75b09d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 200 len: 1393 microversion: 2.1 time: 0.228793 Apr 13 21:59:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 249/754] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 21:59:57 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 1393 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1201758740"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 21:59:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 21:59:58 user devstack@n-api.service[61663]: INFO nova.compute.api [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Attempting to quiesce instance before volume snapshot. Apr 13 21:59:58 user devstack@n-api.service[61663]: INFO nova.compute.api [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 13 21:59:58 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Creating snapshot from volume 6eaa51d1-a9c7-4ca4-b76d-903304f71409. {{(pid=61663) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 13 22:00:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f2ae2ee2-9e6c-4d8f-906c-436bbd39b90e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511/action" status: 202 len: 0 microversion: 2.1 time: 3.905722 Apr 13 22:00:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 250/755] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 21:59:57 2023] POST /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511/action => generated 0 bytes in 3907 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 22:00:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1526232735", "imageRef": "52b8a312-9e02-48e3-b201-4b8e6135b97e", "flavorRef": "42", "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:00:02 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5c98e374-3252-4d7b-9511-81cd4dcdb3e1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:00:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6253fa3f-33bc-45d3-8f12-8d84ab2a1ffb tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.563781 Apr 13 22:00:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 257/756] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:00:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:00:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-633c6890-3b5a-467d-9f7b-0168c31bd512 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:02 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-633c6890-3b5a-467d-9f7b-0168c31bd512 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:02 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-633c6890-3b5a-467d-9f7b-0168c31bd512 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:02 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-633c6890-3b5a-467d-9f7b-0168c31bd512 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 200 len: 1224 microversion: 2.1 time: 0.255655 Apr 13 22:00:02 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 250/757] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:02 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 1224 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] Creating event network-changed:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:00:05 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c1a8094d-5612-4448-aeaf-1476a3482fa6 req-9d096eb5-466a-40cf-ae7d-3730603d69e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051549 Apr 13 22:00:05 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 251/758] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:00:07 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 HTTP/1.1 Apr 13 22:00:07 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:00:07 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:00:07 user devstack@n-api.service[61664]: Connection: close Apr 13 22:00:07 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:00:07 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:00:07 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:00:07 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:00:07 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:00:07 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:00:07 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:00:07 user devstack@n-api.service[61664]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:00:07 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:00:07 user devstack@n-api.service[61664]: method: > Apr 13 22:00:07 user devstack@n-api.service[61664]: exception: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:00:07 user devstack@n-api.service[61664]: action_args: {'id': '78b584a2-7dbc-4793-9d93-37897f9a24b1'} Apr 13 22:00:07 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:00:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:00:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:00:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-26b76b45-3f38-41e6-a340-4830e2ad9ef5 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 404 len: 111 microversion: 2.1 time: 0.029805 Apr 13 22:00:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 258/759] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:07 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:00:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4b4262f1-7b58-4706-820c-e48dcb35654a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '.version_select at 0x7f4b3cb80310>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4b4262f1-7b58-4706-820c-e48dcb35654a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130014745" status: 202 len: 0 microversion: 2.1 time: 0.028494 Apr 13 22:00:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 251/760] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:00:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130014745 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:00:08 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-77d14d8e-0f57-45cc-aac9-2fbbd1d97b3d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c9f3b50>, body: {"keypair": {"name": "tempest-keypair-1140702761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjiikkEbrTg/WryaLvM1VDBK+suc/5Dwvx4Vdfw0N4JZlXsBGsrIYAKH3AVlUtKrIJJ9MHQm23G5QpUddzkgRiVYi6Zqn9zRRQGQMAPCalG/ExBhF8Y3ZVyscy/IXA5kg=="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:08 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-77d14d8e-0f57-45cc-aac9-2fbbd1d97b3d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:08 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-77d14d8e-0f57-45cc-aac9-2fbbd1d97b3d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:08 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-77d14d8e-0f57-45cc-aac9-2fbbd1d97b3d tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061951 Apr 13 22:00:08 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 252/761] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:00:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1306572424", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88d8592d-4fff-4951-a1b8-140984c24696"}], "security_groups": [{"name": "tempest-securitygroup--1884666857"}], "key_name": "tempest-keypair-1140702761", "user_data": "}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:10 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] validate_networks() for [('88d8592d-4fff-4951-a1b8-140984c24696', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:00:11 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:00:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1e804d7c-ea2f-41f6-b915-636119f1030a tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.873173 Apr 13 22:00:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 259/762] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:00:10 2023] POST /compute/v2.1/servers => generated 400 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:00:11 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:11 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d8108061-412b-46d9-bd46-fdcbd4a880b7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:11 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d8108061-412b-46d9-bd46-fdcbd4a880b7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:11 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d8108061-412b-46d9-bd46-fdcbd4a880b7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:11 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d8108061-412b-46d9-bd46-fdcbd4a880b7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 200 len: 1236 microversion: 2.1 time: 0.078463 Apr 13 22:00:11 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 252/763] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:11 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1385621819", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] validate_networks() for None {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Getting quotas for project 9b73574c6bfc4b1685eb2179f040b5a6. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Getting quotas for user 604839c420aa40eea9e14d5905f8ea09 and project 9b73574c6bfc4b1685eb2179f040b5a6. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:00:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:00:13 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c7e0f20f-9113-4002-bbae-5f0e7bb6f2ce tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.720432 Apr 13 22:00:13 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 253/764] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:00:13 2023] POST /compute/v2.1/servers => generated 378 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:00:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e2d5ecdd-0218-43e8-8f4d-3d5eae2e6534 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:13 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e2d5ecdd-0218-43e8-8f4d-3d5eae2e6534 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:14 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-e2d5ecdd-0218-43e8-8f4d-3d5eae2e6534 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604839c420aa40eea9e14d5905f8ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b73574c6bfc4b1685eb2179f040b5a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:14 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e2d5ecdd-0218-43e8-8f4d-3d5eae2e6534 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" status: 200 len: 1209 microversion: 2.1 time: 0.077636 Apr 13 22:00:14 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 260/765] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:13 2023] GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] Creating event network-changed:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:00:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-9176430e-2bca-4db4-a5a8-bbba45c9c1d3 req-02c248ff-cf89-4776-b49f-056c182f1b1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038632 Apr 13 22:00:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 253/766] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9b4fb97e-93a0-4063-ad16-c35676217215 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058259 Apr 13 22:00:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 254/767] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:00:15 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:00:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-dd3d9bec-19d7-4bf2-aa70-b66d17d501e7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 204 len: 0 microversion: 2.1 time: 0.152178 Apr 13 22:00:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 261/768] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:00:15 2023] DELETE /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-aaa8f557-9493-41d3-9f86-4de332b45d96 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 200 len: 1676 microversion: 2.1 time: 0.240503 Apr 13 22:00:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 254/769] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:15 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-unplugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] Creating event network-vif-unplugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 22:00:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-22aa4047-53d7-4f8a-8b3b-37354c91f434 req-53c514aa-283d-4f9a-a363-564132c75e8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032453 Apr 13 22:00:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 255/770] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "name": "network-vif-plugged", "status": "completed", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] Creating event network-vif-plugged:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:00:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-b4491ea2-e6df-40d7-9f3b-8aa542c56507 req-a5071a0f-f630-4bde-b43d-6d997c8a384c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073083 Apr 13 22:00:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 262/771] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] Creating event network-changed:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:00:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-17876a25-e129-4aa5-a8cb-76b7ed4e5e1d req-2a557cc5-f1a8-4316-99bb-8487e63b837a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030517 Apr 13 22:00:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 255/772] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-plugged", "status": "completed", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] Creating event network-vif-plugged:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 22:00:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-2f5a18f8-3a30-4dd3-b6fb-58acd2dff874 req-b59ccc7d-99c3-4c11-bc1e-cd545dbb479a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028936 Apr 13 22:00:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 256/773] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "name": "network-vif-plugged", "status": "completed", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] Creating event network-vif-plugged:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:00:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1f111bff-8b40-420d-ba29-dbcc4da5e3ea req-7186736b-2ea4-42ea-9f80-3b5b8e1032f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028684 Apr 13 22:00:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 263/774] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87dfe1b-f651-436d-87b5-eb257ef1a6e8", "name": "network-vif-deleted", "tag": "a438af72-b7ff-4ab6-82f5-59cf460c430f"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] Creating event network-vif-deleted:a438af72-b7ff-4ab6-82f5-59cf460c430f for instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 on user Apr 13 22:00:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-9a4a7532-9c4f-4696-a6e3-66ee46a99817 req-d59397d5-adea-4c9e-bd4c-c781a794f011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042549 Apr 13 22:00:20 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 256/775] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}, {"server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Creating event network-vif-plugged:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:00:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] Creating event network-vif-plugged:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:00:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-a57af0e8-4f60-4498-a721-0c867df2f83a req-9bbc0810-73c2-4d23-b5ff-209f790d9f6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053285 Apr 13 22:00:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 257/776] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:22 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:22 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "name": "network-vif-plugged", "status": "completed", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}, {"server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "name": "network-vif-plugged", "status": "completed", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:22 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Creating event network-vif-plugged:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:00:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] Creating event network-vif-plugged:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:00:22 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-88124d58-a464-4a8c-8ff6-34db8b01aa3b req-8499af24-891f-4c52-b15c-913c5d7bd95d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038089 Apr 13 22:00:22 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 264/777] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:35 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:35 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:35 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=12 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-596484231", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "f414347d-1c32-419c-89fc-b23b61a6c286", "destination_type": "volume"}], "networks": [{"uuid": "5f022439-52f7-4c06-a4f9-6943fddcd352"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] validate_networks() for [('5f022439-52f7-4c06-a4f9-6943fddcd352', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Getting quotas for user 0ab740920cac4befac62a72f7ce5a817 and project 11a30fba887e4114be856d26b47a8e55. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:00:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:00:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-0dcc0cbd-8735-467a-bda5-a05977298700 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.835549 Apr 13 22:00:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 257/778] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 13 22:00:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:36 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-9a4fee32-484a-4a48-b4d9-5e2cf637b775 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1394 microversion: 2.87 time: 0.097740 Apr 13 22:00:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 258/779] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:00:36 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1394 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=14 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] Creating event network-changed:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:00:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-862a9024-5e1d-4892-85e7-50274e0ca737 req-0f9c9d88-0d69-472f-b61f-78f043798c11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113355 Apr 13 22:00:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 265/780] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-f8706862-9b30-457e-be23-b77807a718d7 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad83a0>, body: {"keypair": {"name": "tempest-TestStampPattern-369348447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXtPnwsWU/ZHWadHD9KufzgH+i4W8Whaj89/zf4/lU/5gVOUN68ru0UJiR7TrTwJrSHaGj3qTP3uSclSDGLdxNe17FiKyjg0p2Imd/q5wAr6DX4FJCcSqsRDbLL7AtxQA=="}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:41 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-f8706862-9b30-457e-be23-b77807a718d7 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for project 388f228079fa45cb91fa08b972132fbe. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:41 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-f8706862-9b30-457e-be23-b77807a718d7 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for user 26fb3ecc54c84118b2100ff89cbc87f6 and project 388f228079fa45cb91fa08b972132fbe. Resources: {'key_pairs'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-f8706862-9b30-457e-be23-b77807a718d7 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.135704 Apr 13 22:00:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 258/781] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:00:41 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-421020363", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "key_name": "tempest-TestStampPattern-369348447", "security_groups": [{"name": "tempest-secgroup-smoke-230004448"}], "networks": [{"uuid": "a5cfb4cb-723b-4476-8849-b693ce8adbe5"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] validate_networks() for [('a5cfb4cb-723b-4476-8849-b693ce8adbe5', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for project 388f228079fa45cb91fa08b972132fbe. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for user 26fb3ecc54c84118b2100ff89cbc87f6 and project 388f228079fa45cb91fa08b972132fbe. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:00:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:00:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-52c022bb-b285-40b8-9675-acde4b045d48 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.608032 Apr 13 22:00:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 259/782] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:00:43 2023] POST /compute/v2.1/servers => generated 403 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:00:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-da8de14d-806e-4366-9495-d4e73f40c5a8 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:44 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-da8de14d-806e-4366-9495-d4e73f40c5a8 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:44 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-da8de14d-806e-4366-9495-d4e73f40c5a8 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-da8de14d-806e-4366-9495-d4e73f40c5a8 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 200 len: 1235 microversion: 2.1 time: 0.114998 Apr 13 22:00:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 266/783] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:44 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 1235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] Creating event network-changed:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:00:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-443d770b-90ef-44e8-839d-3286f6bcb8af req-507008f1-1500-4be3-a59d-fb2bac435ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031516 Apr 13 22:00:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 259/784] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "name": "network-vif-plugged", "status": "completed", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] Creating event network-vif-plugged:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:00:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8c8235ee-c709-4c4e-b2c3-5ce19828e9c3 req-d5de1dc1-8bf3-4dc7-9e24-4144103b78bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124660 Apr 13 22:00:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 260/785] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:00:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-dd61e05c-1bdf-4f0c-8f0c-98f867e3ed3c req-59f29afb-f596-4faa-9d18-9d3987dd0a65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035812 Apr 13 22:00:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 267/786] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:51 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=10 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:00:51 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "name": "network-vif-plugged", "status": "completed", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:51 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] Creating event network-vif-plugged:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:00:51 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-de23d385-07d0-4387-a09e-f8fa6cacf3db req-e44339a7-51fa-47e8-98ef-5cc32fe4f66a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037156 Apr 13 22:00:51 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 260/787] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:53 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-94fa398d-a554-45b3-a89f-bdb7df8d055c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 200 len: 1552 microversion: 2.1 time: 0.170619 Apr 13 22:00:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 261/788] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:52 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:00:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:00:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-57591997-2600-47e2-bd91-21e659af0f09 req-b65e8962-7d56-431a-b276-9214988ec09e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038433 Apr 13 22:00:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 268/789] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:54 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c8c55c79-dfba-41e7-a193-8422547e587c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.178010 Apr 13 22:00:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 261/790] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:54 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:00:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:00:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8cf7a07e-1850-4d21-a8c0-57710a8ce1a3 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1724 microversion: 2.1 time: 0.155246 Apr 13 22:00:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 262/791] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:00:54 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:02 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d9ffeae7-6701-40eb-8b3b-b7ddb08d683b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 200 len: 1546 microversion: 2.1 time: 0.179618 Apr 13 22:01:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 269/792] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:01 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604839c420aa40eea9e14d5905f8ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b73574c6bfc4b1685eb2179f040b5a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-245cf0ed-0ca9-42fb-a0e0-6c02f27b91f4 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" status: 200 len: 1454 microversion: 2.1 time: 0.141044 Apr 13 22:01:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 262/793] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:04 2023] GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: b87dfe1b-f651-436d-87b5-eb257ef1a6e8] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HTTP exception thrown: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Request method failure captured: Apr 13 22:01:06 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 HTTP/1.1 Apr 13 22:01:06 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:01:06 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:01:06 user devstack@n-api.service[61663]: Connection: close Apr 13 22:01:06 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:01:06 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:01:06 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:01:06 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:01:06 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHfgINELovSYm__2wxLA9vmb6F19FIFzyHnsB8GCT5zmExK61RxLrWwm71efToqXOq8QYwameGwiiiBIMKv_GuEGgjCT49EWNFTanBBgJi9AWgBRw97_RIogVE9SaXGT6a2lMum3vUzYMiCPuLWMNfHmXWAQPO77p_Iul6EqMk65Hi8 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Project-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70e84a09a76a44eb830e575db4321224"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Tenant-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-User: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:01:06 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:01:06 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:01:06 user devstack@n-api.service[61663]: X-User-Id: e77459bc3fa8496da1a089c460e32ed2 Apr 13 22:01:06 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:01:06 user devstack@n-api.service[61663]: method: > Apr 13 22:01:06 user devstack@n-api.service[61663]: exception: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. Apr 13 22:01:06 user devstack@n-api.service[61663]: action_args: {'id': 'b87dfe1b-f651-436d-87b5-eb257ef1a6e8'} Apr 13 22:01:06 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. Apr 13 22:01:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:01:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Returning 404 to user: Instance b87dfe1b-f651-436d-87b5-eb257ef1a6e8 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:01:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8e839643-4bd2-4598-9988-d6db5c7671d7 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8" status: 404 len: 111 microversion: 2.1 time: 0.043162 Apr 13 22:01:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 263/794] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:06 2023] GET /compute/v2.1/servers/b87dfe1b-f651-436d-87b5-eb257ef1a6e8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:01:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c05d2bee-38af-4192-a938-bcfd7b9721ac tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '.version_select at 0x7f4b3c7a1360>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c05d2bee-38af-4192-a938-bcfd7b9721ac tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299306137" status: 202 len: 0 microversion: 2.1 time: 0.025471 Apr 13 22:01:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 270/795] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:01:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299306137 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:12 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:01:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9d839c3a-4e76-4ad9-b292-639fefd2bf26 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 204 len: 0 microversion: 2.1 time: 0.135464 Apr 13 22:01:12 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 263/796] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:01:12 2023] DELETE /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:12 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b0308adf-7474-411e-93d2-972a2ff9e1fe tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 200 len: 1495 microversion: 2.1 time: 0.205476 Apr 13 22:01:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 264/797] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:12 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 1495 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-unplugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] Creating event network-vif-unplugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 22:01:12 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e035a383-7b11-4bbc-8d87-415b94c405d0 req-3114907f-7c81-4dac-a651-0f3a2474ae50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036992 Apr 13 22:01:12 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 271/798] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:13 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-deleted", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:13 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] Creating event network-vif-deleted:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 22:01:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-061a674b-a1f5-48a1-a4e0-67659080e6b1 req-6dbe4841-52bb-4cbf-99b5-c539b5b8c544 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030222 Apr 13 22:01:14 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 264/799] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68cb788e-be1f-44fc-b65e-b908a5831ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b4a7d649-3cf1-4452-9f1d-430f0ce841ca"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] Creating event network-vif-plugged:b4a7d649-3cf1-4452-9f1d-430f0ce841ca for instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 on user Apr 13 22:01:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-da1bd4e6-1c5d-4e89-aaec-845dc18a41bd req-0de4fb61-865f-496b-9c4e-57da348091ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Apr 13 22:01:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 265/800] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:26 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b21502ab-d031-440d-8fde-5e4ba44284af tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1769 microversion: 2.87 time: 0.153890 Apr 13 22:01:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 272/801] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:01:26 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1769 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1af0f51f-123f-4ee9-b4f1-17901b9aa8a9 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 200 len: 1537 microversion: 2.1 time: 0.149952 Apr 13 22:01:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 265/802] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:34 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-adbe93d8-aa5c-47b3-aabf-33ba46f5e6be tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 200 len: 1552 microversion: 2.1 time: 0.148673 Apr 13 22:01:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 266/803] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:53 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:01:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-704aa73a-c4f0-4d60-89b7-d70847552d51 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 204 len: 0 microversion: 2.1 time: 0.122283 Apr 13 22:01:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 273/804] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:01:53 2023] DELETE /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-45d4ebce-eaa3-449e-a7cd-c5a9713ff46c tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 200 len: 1558 microversion: 2.1 time: 0.193057 Apr 13 22:01:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 266/805] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:53 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "name": "network-vif-unplugged", "status": "completed", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:53 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] Creating event network-vif-unplugged:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:01:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-cac493a4-f044-44fc-81e0-3dfd436f12a0 req-6892d84c-7c98-4f80-834d-5e723cd62fce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040704 Apr 13 22:01:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 267/806] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:01:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c9b5c877-d45f-44c5-a952-4ab02051e1db tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 204 len: 0 microversion: 2.1 time: 0.119685 Apr 13 22:01:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 274/807] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:01:54 2023] DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:54 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:01:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a54e0214-4a32-4dbc-b638-7f684e880955 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 200 len: 1730 microversion: 2.1 time: 0.190541 Apr 13 22:01:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 267/808] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:01:54 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:01:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "name": "network-vif-deleted", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] Creating event network-vif-deleted:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:01:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-25767b0f-0155-4eb1-b34a-eebb7578ab6c req-f76a083c-b9f8-4337-ba98-291a15de67d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038970 Apr 13 22:01:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 268/809] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad162f6-4270-468f-baa6-52bbb7e0adfe", "name": "network-vif-plugged", "status": "completed", "tag": "b3d59b06-5861-436f-abe4-a543fe5e6229"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-unplugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}, {"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-plugged", "status": "completed", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:55 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Creating event network-vif-plugged:b3d59b06-5861-436f-abe4-a543fe5e6229 for instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe on user Apr 13 22:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Creating event network-vif-unplugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 22:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] Creating event network-vif-plugged:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 22:01:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8869387c-9f50-4917-919f-ffc456222aa3 req-eaee0d32-98e8-4a1d-9ed9-a347c0c4625b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.040891 Apr 13 22:01:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 275/810] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:01:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c895d9cf-e6c1-42d6-88e3-1209b203fbe3", "name": "network-vif-deleted", "tag": "03480082-c22f-4ad9-bc15-d536f115ec88"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:01:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:01:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:01:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:01:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] Creating event network-vif-deleted:03480082-c22f-4ad9-bc15-d536f115ec88 for instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 on user Apr 13 22:01:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-4db03788-5918-43b6-a7e4-7b9799b24ef5 req-45ae9398-43df-4e69-922f-4f3aba1f9b9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031604 Apr 13 22:01:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 268/811] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4f602073-ea34-48a4-955e-37f2acee5d99 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.086709 Apr 13 22:02:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 269/812] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:02:02 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-interface => generated 282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: 68cb788e-be1f-44fc-b65e-b908a5831ae2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HTTP exception thrown: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Request method failure captured: Apr 13 22:02:03 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 HTTP/1.1 Apr 13 22:02:03 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:02:03 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:02:03 user devstack@n-api.service[61664]: Connection: close Apr 13 22:02:03 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:02:03 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:02:03 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:02:03 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:02:03 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHfgINELovSYm__2wxLA9vmb6F19FIFzyHnsB8GCT5zmExK61RxLrWwm71efToqXOq8QYwameGwiiiBIMKv_GuEGgjCT49EWNFTanBBgJi9AWgBRw97_RIogVE9SaXGT6a2lMum3vUzYMiCPuLWMNfHmXWAQPO77p_Iul6EqMk65Hi8 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Project-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70e84a09a76a44eb830e575db4321224"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Tenant-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-User: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:02:03 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:02:03 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:02:03 user devstack@n-api.service[61664]: X-User-Id: e77459bc3fa8496da1a089c460e32ed2 Apr 13 22:02:03 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:02:03 user devstack@n-api.service[61664]: method: > Apr 13 22:02:03 user devstack@n-api.service[61664]: exception: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. Apr 13 22:02:03 user devstack@n-api.service[61664]: action_args: {'id': '68cb788e-be1f-44fc-b65e-b908a5831ae2'} Apr 13 22:02:03 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. Apr 13 22:02:03 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Returning 404 to user: Instance 68cb788e-be1f-44fc-b65e-b908a5831ae2 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d910015e-6045-4421-b7d7-784ccfd24d62 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2" status: 404 len: 111 microversion: 2.1 time: 0.216321 Apr 13 22:02:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 276/813] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:02 2023] GET /compute/v2.1/servers/68cb788e-be1f-44fc-b65e-b908a5831ae2 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:02:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6d95089b-74ee-4cf0-b956-bf8366f3660a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 204 len: 0 microversion: 2.1 time: 0.126285 Apr 13 22:02:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 269/814] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:02:03 2023] DELETE /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] Creating event network-changed:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c9c968f0-030e-4f94-b106-23384e17710b req-a07d237a-1bdb-40d6-860e-4b82ced5cd93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033622 Apr 13 22:02:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 277/815] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7f63933d-cc13-4875-bfb4-e4e03aba0f12 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/ips" status: 200 len: 108 microversion: 2.1 time: 0.050653 Apr 13 22:02:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 270/816] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:02:03 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/ips => generated 108 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77459bc3fa8496da1a089c460e32ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70e84a09a76a44eb830e575db4321224', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d0394966-e924-4c2f-acd4-ec20ea65911a tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 200 len: 1509 microversion: 2.1 time: 0.216033 Apr 13 22:02:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 270/817] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:03 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] Creating event network-vif-unplugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 22:02:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-acf95543-a1ab-4341-9d37-a9dfc1a354e4 req-0099e35a-4e2f-4a43-b983-b1d330218291 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105977 Apr 13 22:02:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 278/818] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:02:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c6fe8490-53f7-44bb-b6ac-388b36605ff5 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" status: 204 len: 0 microversion: 2.1 time: 0.126678 Apr 13 22:02:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 271/819] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:02:04 2023] DELETE /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:04 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '604839c420aa40eea9e14d5905f8ea09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b73574c6bfc4b1685eb2179f040b5a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c1620a3f-5cfd-4570-ad73-b928f2bd93b9 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" status: 200 len: 1460 microversion: 2.1 time: 0.184086 Apr 13 22:02:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 271/820] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:04 2023] GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => generated 1460 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-deleted", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] Creating event network-vif-deleted:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 22:02:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-35a236b6-b86d-455e-9225-16868beaf881 req-fce9a056-125b-4a9a-8617-7eb9f082cbd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027784 Apr 13 22:02:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 279/821] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:05 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de", "name": "network-vif-plugged", "status": "completed", "tag": "fdc6b9f2-62b6-44df-a2e4-e923e1e57964"}, {"server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "name": "network-vif-unplugged", "status": "completed", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}, {"server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "name": "network-vif-plugged", "status": "completed", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Creating event network-vif-plugged:fdc6b9f2-62b6-44df-a2e4-e923e1e57964 for instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de on user Apr 13 22:02:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Creating event network-vif-unplugged:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:02:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] Creating event network-vif-plugged:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:02:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0704f11c-2613-4d70-bd5f-542a56bcd048 req-698ab266-b794-4ed0-a5d4-c74fb705c152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033454 Apr 13 22:02:05 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 272/822] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:05 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57a893b-7da3-4c12-874b-eceb300c851f"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:05 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-45a9bff2-02ee-407b-84de-baf31b190d51 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305234 Apr 13 22:02:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 272/823] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:02:05 2023] POST /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2", "name": "network-vif-deleted", "tag": "c8f5bfca-9b9a-46c0-8b2f-baefb56590d9"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:07 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] Creating event network-vif-deleted:c8f5bfca-9b9a-46c0-8b2f-baefb56590d9 for instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 on user Apr 13 22:02:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-036bff9f-491e-4781-b604-facba6572b31 req-f998ceda-06d5-4dca-9d29-bdfcd2fdfeab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029036 Apr 13 22:02:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 280/824] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d57a893b-7da3-4c12-874b-eceb300c851f"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:02:12 user devstack@n-api.service[61665]: request: POST /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments HTTP/1.1 Apr 13 22:02:12 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:02:12 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:02:12 user devstack@n-api.service[61665]: Connection: close Apr 13 22:02:12 user devstack@n-api.service[61665]: Content-Length: 74 Apr 13 22:02:12 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:02:12 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:02:12 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:02:12 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:02:12 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:02:12 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:02:12 user devstack@n-api.service[61665]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:02:12 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:02:12 user devstack@n-api.service[61665]: Apr 13 22:02:12 user devstack@n-api.service[61665]: {"volumeAttachment": {"volumeId": "d57a893b-7da3-4c12-874b-eceb300c851f"}} Apr 13 22:02:12 user devstack@n-api.service[61665]: method: > Apr 13 22:02:12 user devstack@n-api.service[61665]: exception: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b Apr 13 22:02:12 user devstack@n-api.service[61665]: action_args: {'server_id': '37c5f603-6f39-4fc7-a86e-be1b6cebde5b', 'body': {'volumeAttachment': {'volumeId': 'd57a893b-7da3-4c12-874b-eceb300c851f'}}} Apr 13 22:02:12 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b Apr 13 22:02:12 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:12 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 400 to user: Invalid volume: volume d57a893b-7da3-4c12-874b-eceb300c851f is already attached to instances: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:12 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b3050602-332f-4201-ba0e-0f7786b716df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098847 Apr 13 22:02:12 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 273/825] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:02:12 2023] POST /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:12 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'services' on Instance uuid 37c5f603-6f39-4fc7-a86e-be1b6cebde5b {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:02:12 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-aa8c788a-04f1-4776-ab38-d36731f7ba65 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments/d57a893b-7da3-4c12-874b-eceb300c851f" status: 202 len: 0 microversion: 2.1 time: 0.163742 Apr 13 22:02:12 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 273/826] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:02:12 2023] DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments/d57a893b-7da3-4c12-874b-eceb300c851f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:12 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-db9f35a4-d2e1-4b45-a0ed-a05da91b70de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Apr 13 22:02:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 281/827] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:02:12 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "340fc440-34ba-4f8f-a632-7f55fd754e85"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:27 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lazy-loading 'flavor' on Instance uuid e874e1c2-9dd4-4ca5-b273-abd35526d921 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:02:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d4125414-7710-453c-8399-3877260c1c98 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921/action" status: 200 len: 29 microversion: 2.87 time: 0.341020 Apr 13 22:02:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 274/828] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 22:02:27 2023] POST /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921/action => generated 29 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:27 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-32fdb16b-9bce-4715-b71e-6c115d1c28ef tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1775 microversion: 2.87 time: 0.257825 Apr 13 22:02:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 274/829] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:02:27 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1775 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-unplugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:28 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] Creating event network-vif-unplugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:02:28 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-12432839-1bbc-444b-acf5-e35e101a7d5e req-672071d6-aabe-4570-9a41-fb7b56791587 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032509 Apr 13 22:02:28 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 282/830] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:30 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:30 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:02:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-4b8bd25e-656b-4ef1-970c-9dd1b0f5a419 req-2d50d1dd-a7cb-4057-b853-fa735e9df3eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029853 Apr 13 22:02:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 275/831] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:02:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d12b4b09-a196-449c-bf83-b341ed88daf6 req-538bf9fe-74c2-47e0-9c5d-b0792dd58029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044981 Apr 13 22:02:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 275/832] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:35 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-18285929-c579-4ae0-bb91-54ae3a6d2f49 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 200 len: 1537 microversion: 2.1 time: 0.165307 Apr 13 22:02:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 283/833] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:35 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:35 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:35 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:02:35 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-a688e63d-7d7d-4a02-ba8a-3a1baf2f721b req-dc751548-f8a9-4140-974d-935f596d200d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030336 Apr 13 22:02:35 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 276/834] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] Creating event network-changed:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:02:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-167b3898-6bba-4075-830e-2e9a5079e939 req-996d328d-6854-498e-9438-25588b91db6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036723 Apr 13 22:02:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 276/835] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a790c3c4-c019-4667-acd2-5fd9108e7fdd"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ede51165-4717-4881-be37-38e5309ea428 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361314 Apr 13 22:02:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 284/836] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:02:36 2023] POST /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:02:43 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe HTTP/1.1 Apr 13 22:02:43 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:02:43 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:02:43 user devstack@n-api.service[61665]: Connection: close Apr 13 22:02:43 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:02:43 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:02:43 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:02:43 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:02:43 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:02:43 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:02:43 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:02:43 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:02:43 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:02:43 user devstack@n-api.service[61665]: method: > Apr 13 22:02:43 user devstack@n-api.service[61665]: exception: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:02:43 user devstack@n-api.service[61665]: action_args: {'id': '1ad162f6-4270-468f-baa6-52bbb7e0adfe'} Apr 13 22:02:43 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:02:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d9b09754-8d6c-4718-acf9-015a90645bf6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 404 len: 111 microversion: 2.1 time: 0.031596 Apr 13 22:02:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 277/837] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:43 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:02:44 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 HTTP/1.1 Apr 13 22:02:44 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:02:44 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:02:44 user devstack@n-api.service[61663]: Connection: close Apr 13 22:02:44 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:02:44 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:02:44 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:02:44 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:02:44 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:44 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:44 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:02:44 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:02:44 user devstack@n-api.service[61663]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:02:44 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:44 user devstack@n-api.service[61663]: method: > Apr 13 22:02:44 user devstack@n-api.service[61663]: exception: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:44 user devstack@n-api.service[61663]: action_args: {'id': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'} Apr 13 22:02:44 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:44 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:02:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d9a26c2b-93a7-42a2-b70a-c492ba3fc15b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 404 len: 111 microversion: 2.1 time: 0.033184 Apr 13 22:02:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 277/838] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:44 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:02:45 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments HTTP/1.1 Apr 13 22:02:45 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:02:45 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:02:45 user devstack@n-api.service[61664]: Connection: close Apr 13 22:02:45 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:02:45 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:02:45 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:02:45 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:02:45 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:45 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:02:45 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:02:45 user devstack@n-api.service[61664]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:02:45 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:45 user devstack@n-api.service[61664]: method: > Apr 13 22:02:45 user devstack@n-api.service[61664]: exception: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61664]: action_args: {'server_id': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'} Apr 13 22:02:45 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:45 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9c45466f-c6a8-4971-bca0-0a1e6fa43683 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032121 Apr 13 22:02:45 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 285/839] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:02:45 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:02:45 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 HTTP/1.1 Apr 13 22:02:45 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:02:45 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:02:45 user devstack@n-api.service[61665]: Connection: close Apr 13 22:02:45 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:02:45 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:02:45 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:02:45 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:02:45 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:02:45 user devstack@n-api.service[61665]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:45 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:02:45 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:02:45 user devstack@n-api.service[61665]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:02:45 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:02:45 user devstack@n-api.service[61665]: method: > Apr 13 22:02:45 user devstack@n-api.service[61665]: exception: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61665]: action_args: {'id': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'} Apr 13 22:02:45 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:02:45 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-40dd6c78-eceb-4e99-b665-0e6c652b7d0a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 404 len: 111 microversion: 2.1 time: 0.030467 Apr 13 22:02:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 278/840] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:45 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-964549732", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c"}], "security_groups": [{"name": "tempest-securitygroup--1201005079"}], "key_name": "tempest-keypair-1140865131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] validate_networks() for [('1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a9433a61-2519-48aa-b2bc-0d45a9377dc2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.611965 Apr 13 22:02:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 278/841] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:02:45 2023] POST /compute/v2.1/servers => generated 404 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-3c794918-ea79-4651-9682-147353e56caf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-3c794918-ea79-4651-9682-147353e56caf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:45 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:02:45 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-3c794918-ea79-4651-9682-147353e56caf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:45 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-3c794918-ea79-4651-9682-147353e56caf tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 200 len: 1232 microversion: 2.1 time: 0.073959 Apr 13 22:02:45 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 279/842] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:45 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 1232 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:46 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'services' on Instance uuid 061e133a-9d17-4ff9-839a-235b05f9dd93 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:02:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c770eaa3-50fa-4336-b156-f13421664a09 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 204 len: 0 microversion: 2.1 time: 0.136223 Apr 13 22:02:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 279/843] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:02:45 2023] DELETE /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9477637c-011f-4a83-aeb9-af36ab00cce4 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments/a790c3c4-c019-4667-acd2-5fd9108e7fdd" status: 202 len: 0 microversion: 2.1 time: 0.228862 Apr 13 22:02:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 286/844] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:02:45 2023] DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments/a790c3c4-c019-4667-acd2-5fd9108e7fdd => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7f0cace4-7556-432c-8e92-ff2bad464668 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Apr 13 22:02:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 280/845] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:02:46 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:46 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:02:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b27cdf04-cdab-450e-8dec-f0af7c42a82b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 200 len: 1399 microversion: 2.1 time: 0.190866 Apr 13 22:02:46 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 280/846] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:46 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 1399 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:02:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "name": "network-vif-unplugged", "status": "completed", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] Creating event network-vif-unplugged:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 22:02:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-95f3bb28-a65f-4c6d-8d77-6c751bfe752a req-73cfcc71-7700-41ab-ba67-5e63907acda6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030277 Apr 13 22:02:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 287/847] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:48 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "name": "network-vif-deleted", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:48 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] Creating event network-vif-deleted:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 22:02:48 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e029bae7-187f-4f3e-aab6-3527d39d3c4e req-590a8356-b99f-4654-bf79-50643f5b9daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029676 Apr 13 22:02:48 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 281/848] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:02:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15a855b1-8253-4b57-b675-edeee6a91511", "name": "network-vif-plugged", "status": "completed", "tag": "a9ff5635-bea0-434b-bdb6-4004eefa847a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] Creating event network-vif-plugged:a9ff5635-bea0-434b-bdb6-4004eefa847a for instance 15a855b1-8253-4b57-b675-edeee6a91511 on user Apr 13 22:02:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-e543be1d-03d6-4b5f-a57c-16d38e6ff7aa req-7047e743-1dd2-49c0-a21b-8c6dcf4ed5e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031875 Apr 13 22:02:48 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 281/849] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] Creating event network-changed:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:02:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-022e29b1-d7d5-4d09-ad21-80536812a9d4 req-11125767-4e9a-45bc-a1db-baf9871d275a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Apr 13 22:02:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 288/850] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "name": "network-vif-plugged", "status": "completed", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}, {"server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "name": "network-vif-plugged", "status": "completed", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:02:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Creating event network-vif-plugged:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:02:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] Creating event network-vif-plugged:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:02:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c1675d45-1605-4414-a7f2-88069ff764ce req-b10693f0-61df-47ba-b509-e2061a673b7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030637 Apr 13 22:02:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 282/851] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:02:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] [instance: f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] HTTP exception thrown: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Request method failure captured: Apr 13 22:02:53 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de HTTP/1.1 Apr 13 22:02:53 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:02:53 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:02:53 user devstack@n-api.service[61665]: Connection: close Apr 13 22:02:53 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:02:53 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:02:53 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:02:53 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:02:53 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHfgINELovSYm__2wxLA9vmb6F19FIFzyHnsB8GCT5zmExK61RxLrWwm71efToqXOq8QYwameGwiiiBIMKv_GuEGgjCT49EWNFTanBBgJi9AWgBRw97_RIogVE9SaXGT6a2lMum3vUzYMiCPuLWMNfHmXWAQPO77p_Iul6EqMk65Hi8 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Project-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/70e84a09a76a44eb830e575db4321224"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/70e84a09a76a44eb830e575db4321224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Tenant-Id: 70e84a09a76a44eb830e575db4321224 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-546430736 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-User: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:02:53 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:02:53 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:02:53 user devstack@n-api.service[61665]: X-User-Id: e77459bc3fa8496da1a089c460e32ed2 Apr 13 22:02:53 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerRescueNegativeTestJSON-546430736-project-member Apr 13 22:02:53 user devstack@n-api.service[61665]: method: > Apr 13 22:02:53 user devstack@n-api.service[61665]: exception: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. Apr 13 22:02:53 user devstack@n-api.service[61665]: action_args: {'id': 'f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de'} Apr 13 22:02:53 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. Apr 13 22:02:53 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:02:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] Returning 404 to user: Instance f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5ce36894-97cd-4e6c-b917-4f5a850a0f64 tempest-ServerRescueNegativeTestJSON-546430736 tempest-ServerRescueNegativeTestJSON-546430736-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de" status: 404 len: 111 microversion: 2.1 time: 0.028834 Apr 13 22:02:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 282/852] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:53 2023] GET /compute/v2.1/servers/f78ca6f1-c156-4aa1-a96b-5c3b84bdf7de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] [instance: 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:02:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] HTTP exception thrown: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Request method failure captured: Apr 13 22:02:54 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 HTTP/1.1 Apr 13 22:02:54 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:02:54 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:02:54 user devstack@n-api.service[61664]: Connection: close Apr 13 22:02:54 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:02:54 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:02:54 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:02:54 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:02:54 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHtqsrBZBbAzXkPLlXLIXAIYH63dFcRZPb1bNw2ClDj0vbL9cP5dN7CLBj3D2TxW9lbV7-kVYyVQrdhWw6Iq1unR-Ok2ZIxdKpR-rSg-D2-UEFiK7rrgIGR88UyOiQ6UMhuk65xUW6tiNFcpHG37mZQuGQ7xoJYA-kWs9-1AMypwI9A Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Project-Id: 9b73574c6bfc4b1685eb2179f040b5a6 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesNegativeTest-1805091735 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9b73574c6bfc4b1685eb2179f040b5a6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b73574c6bfc4b1685eb2179f040b5a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b73574c6bfc4b1685eb2179f040b5a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesNegativeTest-1805091735 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Tenant-Id: 9b73574c6bfc4b1685eb2179f040b5a6 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesNegativeTest-1805091735 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-User: tempest-VolumesNegativeTest-1805091735-project-member Apr 13 22:02:54 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:02:54 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:02:54 user devstack@n-api.service[61664]: X-User-Id: 604839c420aa40eea9e14d5905f8ea09 Apr 13 22:02:54 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesNegativeTest-1805091735-project-member Apr 13 22:02:54 user devstack@n-api.service[61664]: method: > Apr 13 22:02:54 user devstack@n-api.service[61664]: exception: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. Apr 13 22:02:54 user devstack@n-api.service[61664]: action_args: {'id': '9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2'} Apr 13 22:02:54 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. Apr 13 22:02:54 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:02:54 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] Returning 404 to user: Instance 9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:02:54 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e9256f07-366e-452b-a3ae-3de82ea3f024 tempest-VolumesNegativeTest-1805091735 tempest-VolumesNegativeTest-1805091735-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2" status: 404 len: 111 microversion: 2.1 time: 0.029946 Apr 13 22:02:54 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 289/853] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:02:54 2023] GET /compute/v2.1/servers/9d6a20ac-1df9-4fe5-80e9-65778d2c3bd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d075f055-021a-4c24-a67e-b8c74d2c0b18 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056803 Apr 13 22:03:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 283/854] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:03:03 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=21 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:03:03 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-45d52018-1725-4d28-94d0-ad3adec0910b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 204 len: 0 microversion: 2.1 time: 0.131695 Apr 13 22:03:03 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 283/855] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:03:03 2023] DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:03 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7fe2ef0a-5752-440f-9f74-be50af75e240 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 200 len: 1671 microversion: 2.1 time: 0.224565 Apr 13 22:03:03 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 290/856] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:03 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "name": "network-vif-unplugged", "status": "completed", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] Creating event network-vif-unplugged:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:03:03 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-ba5871fc-20a3-4107-baf1-bd5e36f11fcb req-2603211f-9ece-4e2a-adda-edf4ac9082a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057323 Apr 13 22:03:03 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 284/857] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:05 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "name": "network-vif-deleted", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:05 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] Creating event network-vif-deleted:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:03:05 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-43caae0f-1c35-4fd0-b5bd-00290fe19767 req-b2f2935f-573d-4fe4-a4fd-42e4bcb9a9a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032793 Apr 13 22:03:05 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 284/858] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37c5f603-6f39-4fc7-a86e-be1b6cebde5b", "name": "network-vif-plugged", "status": "completed", "tag": "b2a829d9-30f3-4537-8cd8-610561188ec1"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=19 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:05 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] Creating event network-vif-plugged:b2a829d9-30f3-4537-8cd8-610561188ec1 for instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b on user Apr 13 22:03:05 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-3724bd69-20d3-4a42-97f0-162e903338a5 req-b7c4232d-3dea-4c4d-8f79-368ca3761a05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037835 Apr 13 22:03:05 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 291/859] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-323ab089-cfce-4dfd-b695-4c817ebe2fb9 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1755 microversion: 2.87 time: 0.168407 Apr 13 22:03:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 285/860] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:03:17 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-567845c0-cedf-4076-832c-72ec9c531dd7 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 200 len: 1539 microversion: 2.1 time: 0.159218 Apr 13 22:03:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 285/861] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:36 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 1539 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ee2d93b3-aac2-48c3-a45e-710fcc3c4e08 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048604 Apr 13 22:03:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 292/862] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:03:36 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:03:36 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 HTTP/1.1 Apr 13 22:03:36 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:03:36 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:03:36 user devstack@n-api.service[61663]: Connection: close Apr 13 22:03:36 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:03:36 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:03:36 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:03:36 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:03:36 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61663]: method: > Apr 13 22:03:36 user devstack@n-api.service[61663]: exception: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: action_args: {'id': '15a855b1-8253-4b57-b675-edeee6a91511'} Apr 13 22:03:36 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-38ed4b18-8509-40d0-ac7e-aa04eee51f4e tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 404 len: 111 microversion: 2.1 time: 0.140417 Apr 13 22:03:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 286/863] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:36 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:03:36 user devstack@n-api.service[61665]: request: DELETE /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe HTTP/1.1 Apr 13 22:03:36 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:03:36 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:03:36 user devstack@n-api.service[61665]: Connection: close Apr 13 22:03:36 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:03:36 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:03:36 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:03:36 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:03:36 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61665]: method: > Apr 13 22:03:36 user devstack@n-api.service[61665]: exception: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: action_args: {'id': '1ad162f6-4270-468f-baa6-52bbb7e0adfe'} Apr 13 22:03:36 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-99a36d5d-ec82-4de2-b7b5-41615f3f5866 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 404 len: 111 microversion: 2.1 time: 0.027641 Apr 13 22:03:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 286/864] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:03:36 2023] DELETE /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 1ad162f6-4270-468f-baa6-52bbb7e0adfe] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:03:36 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe HTTP/1.1 Apr 13 22:03:36 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:03:36 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:03:36 user devstack@n-api.service[61664]: Connection: close Apr 13 22:03:36 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:03:36 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:03:36 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:03:36 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:03:36 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61664]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:03:36 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61664]: method: > Apr 13 22:03:36 user devstack@n-api.service[61664]: exception: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61664]: action_args: {'id': '1ad162f6-4270-468f-baa6-52bbb7e0adfe'} Apr 13 22:03:36 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. Apr 13 22:03:36 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 1ad162f6-4270-468f-baa6-52bbb7e0adfe could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ff27e6ea-02dc-4658-a209-0a542bf64b06 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe" status: 404 len: 111 microversion: 2.1 time: 0.030927 Apr 13 22:03:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 293/865] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:36 2023] GET /compute/v2.1/servers/1ad162f6-4270-468f-baa6-52bbb7e0adfe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:03:36 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 HTTP/1.1 Apr 13 22:03:36 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:03:36 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:03:36 user devstack@n-api.service[61663]: Connection: close Apr 13 22:03:36 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:03:36 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:03:36 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:03:36 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:03:36 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:03:36 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61663]: method: > Apr 13 22:03:36 user devstack@n-api.service[61663]: exception: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: action_args: {'id': '15a855b1-8253-4b57-b675-edeee6a91511'} Apr 13 22:03:36 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-eabf54c7-4f4c-4508-b896-9e04c7a5412d tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 404 len: 111 microversion: 2.1 time: 0.035523 Apr 13 22:03:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 287/866] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:03:36 2023] DELETE /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 15a855b1-8253-4b57-b675-edeee6a91511] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:03:36 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 HTTP/1.1 Apr 13 22:03:36 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:03:36 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:03:36 user devstack@n-api.service[61665]: Connection: close Apr 13 22:03:36 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:03:36 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:03:36 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:03:36 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:03:36 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:03:36 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:03:36 user devstack@n-api.service[61665]: method: > Apr 13 22:03:36 user devstack@n-api.service[61665]: exception: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: action_args: {'id': '15a855b1-8253-4b57-b675-edeee6a91511'} Apr 13 22:03:36 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. Apr 13 22:03:36 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:03:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 15a855b1-8253-4b57-b675-edeee6a91511 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-7c0ab406-f98d-4dff-b639-e7a1af16e69b tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511" status: 404 len: 111 microversion: 2.1 time: 0.037680 Apr 13 22:03:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 287/867] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:36 2023] GET /compute/v2.1/servers/15a855b1-8253-4b57-b675-edeee6a91511 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7436155d-e19b-4a14-96ce-152863b556d6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c9cfeb0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-949568181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORfhunB7LA94/Vo0IeX5uHg0BK3ZrJIdCSr/QNts93zg201FlS6UuD5bquQQY3opSX8Ui/7/1jLECj4NoRXCObFsyJekLp1y4HjowC79e9IEN0rtSp6qQ2huNvtbuOLUg=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7436155d-e19b-4a14-96ce-152863b556d6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:36 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-7436155d-e19b-4a14-96ce-152863b556d6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7436155d-e19b-4a14-96ce-152863b556d6 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.042741 Apr 13 22:03:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 294/868] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:03:36 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1335681012"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-57a04f6b-effc-4d95-ad96-04361ccc3e99 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/action" status: 202 len: 0 microversion: 2.1 time: 0.995876 Apr 13 22:03:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 288/869] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:03:38 2023] POST /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/action => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 13 22:03:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1352949408", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-949568181", "security_groups": [{"name": "tempest-secgroup-smoke-1800243154"}], "block_device_mapping_v2": [{"uuid": "5fa56af9-4ad3-47b4-8234-7ad286b5647f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:42 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:03:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fa56af9-4ad3-47b4-8234-7ad286b5647f',volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:03:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-da088649-baa6-4768-bb95-b7fe32dafa65 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.871055 Apr 13 22:03:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 288/870] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:03:42 2023] POST /compute/v2.1/servers => generated 404 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:03:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a5c041f2-ee57-4ad7-95ad-7d0b495d7e44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:43 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a5c041f2-ee57-4ad7-95ad-7d0b495d7e44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:43 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a5c041f2-ee57-4ad7-95ad-7d0b495d7e44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a5c041f2-ee57-4ad7-95ad-7d0b495d7e44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 200 len: 1089 microversion: 2.1 time: 0.090559 Apr 13 22:03:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 295/871] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:43 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:03:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] Creating event network-changed:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:03:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d5d4d574-972d-441b-9169-3d24ab37a944 req-8adcde65-6457-4aba-a5a9-57a4e232a859 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042797 Apr 13 22:03:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 289/872] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2025917295", "imageRef": "bd40dedc-e511-4505-afbf-c9ff13ef51b7", "flavorRef": "42", "key_name": "tempest-TestStampPattern-369348447", "security_groups": [{"name": "tempest-secgroup-smoke-230004448"}], "networks": [{"uuid": "a5cfb4cb-723b-4476-8849-b693ce8adbe5"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:48 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] validate_networks() for [('a5cfb4cb-723b-4476-8849-b693ce8adbe5', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for project 388f228079fa45cb91fa08b972132fbe. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Getting quotas for user 26fb3ecc54c84118b2100ff89cbc87f6 and project 388f228079fa45cb91fa08b972132fbe. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:03:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd40dedc-e511-4505-afbf-c9ff13ef51b7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:03:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-870cb204-7250-4821-8797-7228b6f3bf5d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.693217 Apr 13 22:03:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 289/873] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:03:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:03:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9a072aad-a46e-4955-ad14-e01b15e8a121 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-9a072aad-a46e-4955-ad14-e01b15e8a121 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:49 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=9 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:03:49 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-9a072aad-a46e-4955-ad14-e01b15e8a121 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9a072aad-a46e-4955-ad14-e01b15e8a121 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 200 len: 1236 microversion: 2.1 time: 0.100119 Apr 13 22:03:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 296/874] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:49 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:03:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] Creating event network-changed:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:03:51 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-179ea4b6-f4e6-4ce9-825e-ca73f2417fa4 req-8bf4a919-dadf-46e5-b679-ea98057cd2a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044765 Apr 13 22:03:51 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 290/875] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "name": "network-vif-plugged", "status": "completed", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] Creating event network-vif-plugged:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:03:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-ff0b1681-59b8-4e61-898b-eee07005bee0 req-928a3ebe-ef94-4ca4-8af9-fc90410681d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Apr 13 22:03:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 290/876] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:03:53 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b HTTP/1.1 Apr 13 22:03:53 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:03:53 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:03:53 user devstack@n-api.service[61664]: Connection: close Apr 13 22:03:53 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:03:53 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:03:53 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:03:53 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:03:53 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:03:53 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:03:53 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:03:53 user devstack@n-api.service[61664]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:03:53 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:03:53 user devstack@n-api.service[61664]: method: > Apr 13 22:03:53 user devstack@n-api.service[61664]: exception: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:03:53 user devstack@n-api.service[61664]: action_args: {'id': '37c5f603-6f39-4fc7-a86e-be1b6cebde5b'} Apr 13 22:03:53 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:03:53 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:03:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:03:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6dd3087d-182e-4fdb-831a-713f6f73c5df tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 404 len: 111 microversion: 2.1 time: 0.040590 Apr 13 22:03:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 297/877] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:53 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:03:53 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-b9e9b137-5d97-426a-b467-08f65ff24a1b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '.version_select at 0x7f4b3c96f1c0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:53 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-b9e9b137-5d97-426a-b467-08f65ff24a1b tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140702761" status: 202 len: 0 microversion: 2.1 time: 0.024872 Apr 13 22:03:53 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 291/878] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:03:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140702761 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:03:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "name": "network-vif-plugged", "status": "completed", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] Creating event network-vif-plugged:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:03:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c9457475-4967-4dbe-9728-67bb1bcba421 req-18f28417-cc6e-40c7-8a8d-8e8fb58111db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Apr 13 22:03:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 291/879] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:55 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9e1c0d9c-e8a5-4461-ab01-f97155ace438 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c9cd120>, body: {"keypair": {"name": "tempest-keypair-548852854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAseL4vxxUJqHfcsgelGZfQ5WSQkMbZV0oNUO7DZ0FmjlJimVjmfBMqZLB9Ro1KBgPzyb7m0hg9gAAFNGEPJ4EP6mvcIQ5RqNpMjHJWx3kG1AmT1sGEoeSLLPvqrv6FT+g=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:55 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-9e1c0d9c-e8a5-4461-ab01-f97155ace438 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "name": "network-vif-plugged", "status": "completed", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:55 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-9e1c0d9c-e8a5-4461-ab01-f97155ace438 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] Creating event network-vif-plugged:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:03:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-49bfd3bc-ac65-48e7-a4ad-ce41c298b2b0 req-3a2b554c-0a99-4252-a6e1-543616af8f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038456 Apr 13 22:03:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 292/880] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:55 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9e1c0d9c-e8a5-4461-ab01-f97155ace438 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060802 Apr 13 22:03:55 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 298/881] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:03:55 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:56 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "name": "network-vif-plugged", "status": "completed", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] Creating event network-vif-plugged:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:03:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-b648ded3-fe30-4af1-b89c-f8447598f7f4 req-2bdbfc4b-baf2-4d9a-a136-100e4e8bcd90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040628 Apr 13 22:03:56 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 292/882] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:03:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-43325764", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "88d8592d-4fff-4951-a1b8-140984c24696"}], "security_groups": [{"name": "tempest-securitygroup--474066254"}], "key_name": "tempest-keypair-548852854", "user_data": "}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] validate_networks() for [('88d8592d-4fff-4951-a1b8-140984c24696', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:03:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-9350379f-23a4-44df-b16d-d8f66652550c tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Action: 'create', calling method: .version_select at 0x7f4b3c9cfbe0>, body: {"keypair": {"name": "tempest-TestShelveInstance-299000327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApLEuuj6KeDDETqj63aLVZwzI0AEs6gs5+edRAA35t7ojDda06wiLqmdjlWHC2bAnnQxBdroXp1ByYUE2HG9fvtYqO42TNErRms80pT+WCt4ra5LjATp2OXAxx0BUru0w=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:03:57 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-9350379f-23a4-44df-b16d-d8f66652550c tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting quotas for project f16c57e44d2f456cab919015f4b9bb4b. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:57 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-9350379f-23a4-44df-b16d-d8f66652550c tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting quotas for user c8ba9f99764b4e61ac0ed632000fc672 and project f16c57e44d2f456cab919015f4b9bb4b. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:57 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-9350379f-23a4-44df-b16d-d8f66652550c tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.236643 Apr 13 22:03:57 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 299/883] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:03:57 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Getting quotas for user 145c0a177fcc4b94b5480d8806554ac9 and project 446b51db737947ab9bddd5fc47488bc7. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:03:57 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:03:57 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e6e8b9d7-3832-4ffa-94ce-2a19b9fbd37e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.675693 Apr 13 22:03:57 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 293/884] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:03:57 2023] POST /compute/v2.1/servers => generated 399 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:03:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c0e94543-c7c0-4cd9-a6a1-0cd92c48cd5e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:03:57 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c0e94543-c7c0-4cd9-a6a1-0cd92c48cd5e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:03:57 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-c0e94543-c7c0-4cd9-a6a1-0cd92c48cd5e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:03:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c0e94543-c7c0-4cd9-a6a1-0cd92c48cd5e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 200 len: 1233 microversion: 2.1 time: 0.089925 Apr 13 22:03:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 293/885] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:03:57 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] Creating event network-changed:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:04:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-aa4a9364-f914-46f5-9f33-c5bebe7320ec req-b8c4a39c-5f11-4ff4-a634-d03fbb954777 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032804 Apr 13 22:04:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 300/886] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:02 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "name": "network-vif-plugged", "status": "completed", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:02 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] Creating event network-vif-plugged:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:04:02 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-f146a289-df80-461d-a30a-da25fdc33e56 req-3b1c5d5e-fc92-4a37-8ccd-fc2d449d7d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057536 Apr 13 22:04:02 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 294/887] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:02 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1022673409", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-299000327", "security_groups": [{"name": "tempest-secgroup-smoke-493009577"}], "networks": [{"uuid": "42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb"}], "block_device_mapping_v2": [{"uuid": "23dc11c8-0976-4037-a188-9067c88d8f0a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] validate_networks() for [('42f85dac-bb4c-4b1b-b4fa-7783f4f0ebfb', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting quotas for project f16c57e44d2f456cab919015f4b9bb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Getting quotas for user c8ba9f99764b4e61ac0ed632000fc672 and project f16c57e44d2f456cab919015f4b9bb4b. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:04:03 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23dc11c8-0976-4037-a188-9067c88d8f0a',volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:04:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-44667b85-a701-4d2b-a30c-a449fbbe8ea7 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.045399 Apr 13 22:04:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 294/888] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:04:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:04:04 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-26789833-ddcd-4a24-ae73-2e99d2267d13 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:04 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-26789833-ddcd-4a24-ae73-2e99d2267d13 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:04 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-26789833-ddcd-4a24-ae73-2e99d2267d13 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:04 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-26789833-ddcd-4a24-ae73-2e99d2267d13 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1083 microversion: 2.1 time: 0.065075 Apr 13 22:04:04 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 301/889] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:04 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1083 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "name": "network-vif-plugged", "status": "completed", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] Creating event network-vif-plugged:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:04:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-9ce5c80b-7fef-40de-bc7a-141cfcfd16f3 req-1905493b-1e08-4a75-b481-e1b9aa95cd2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034417 Apr 13 22:04:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 295/890] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=9 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:07 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=23 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] Creating event network-changed:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:04:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-aaf6bebd-1a75-422d-b380-c5bf63d51de6 req-b2cf1a59-80dd-494e-9a30-acae9bddceab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038743 Apr 13 22:04:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 295/891] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:13 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:04:13 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-68abb4d8-8a77-4bc4-a2d1-4d9135e09877 req-8fb264c4-6f9f-4426-a3fd-683342208bf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064503 Apr 13 22:04:13 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 302/892] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:04:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-b386e4f1-b571-457c-863c-934d96e2589c req-814375bc-95d2-473f-b75e-9e2b4e86250d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044057 Apr 13 22:04:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 296/893] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=20 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5446afb9-5e11-4dc4-ba1b-b50139bb6adc tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921/action" status: 202 len: 0 microversion: 2.87 time: 0.103863 Apr 13 22:04:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 296/894] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 13 22:04:18 2023] POST /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=18 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:18 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3472600e-95a0-4564-b214-94e8f63e536d tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1763 microversion: 2.87 time: 0.191735 Apr 13 22:04:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 303/895] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:04:18 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1763 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:04:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-unplugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] Creating event network-vif-unplugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-362c4df6-0799-469e-b913-9cd4e090eda7 req-bfbeec6f-e006-4078-8268-f89ed0a2f962 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033663 Apr 13 22:04:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 297/896] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:21 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-unplugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:21 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-unplugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:21 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0e2e5d41-9697-4694-a636-b6514c846c77 req-22a89057-1d5f-4075-816d-04609fe80799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.036790 Apr 13 22:04:21 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 297/897] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:23 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:23 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:04:23 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9f015367-1ad9-409a-821b-4c1dd463dac8 req-a46b0e43-0637-4f90-a6d5-c934c7768e7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033365 Apr 13 22:04:23 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 304/898] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:33 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-cf3d3b98-85fa-4548-8909-cb46459abd66 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 200 len: 1442 microversion: 2.1 time: 0.205513 Apr 13 22:04:33 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 298/899] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:33 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 1442 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6ac0f47e-29f5-42df-aa5c-89bbaada831a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.254036 Apr 13 22:04:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 298/900] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:04:36 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652/os-interface => generated 282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=7 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] Creating event network-changed:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:04:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-61744840-3ccf-4c64-b903-e5e7310a5acd req-72e916a0-dc7b-4556-b0de-8b818c6a8aa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034109 Apr 13 22:04:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 305/901] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0044f8e4-423a-4caf-9810-0df5da6faa7c tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 200 len: 1537 microversion: 2.1 time: 0.145784 Apr 13 22:04:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 299/902] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:39 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 1537 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1601106766", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c"}], "security_groups": [{"name": "tempest-securitygroup--1201005079"}], "key_name": "tempest-keypair-1140865131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f7e87d6a-37e1-4284-90fb-23b6b89ad772", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] validate_networks() for [('1f44a0fc-2a44-4d02-bb6e-fdabdf9ff13c', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:04:41 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7e87d6a-37e1-4284-90fb-23b6b89ad772',volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:04:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5b8beb1b-6270-4747-b29c-7e23a9b94021 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.768221 Apr 13 22:04:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 299/903] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:04:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:04:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d0329f5-ba96-4334-9641-66f9692df41b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5d0329f5-ba96-4334-9641-66f9692df41b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:41 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-5d0329f5-ba96-4334-9641-66f9692df41b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5d0329f5-ba96-4334-9641-66f9692df41b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1076 microversion: 2.1 time: 0.067745 Apr 13 22:04:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 306/904] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:41 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1076 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:44 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:44 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] Creating event network-changed:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:04:44 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-e89742a2-d012-4e95-9e61-7aab90e53e66 req-0edce251-f4ab-438d-a998-e6248180996e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028729 Apr 13 22:04:44 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 300/905] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:48 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ff6af155-4943-4297-a9b9-5f0f887a1509 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 200 len: 1542 microversion: 2.1 time: 0.208428 Apr 13 22:04:48 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 300/906] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:47 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 1542 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:04:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:50 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:04:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f4353de9-1383-4c02-954b-2f89506ccfbb req-d8e172d4-b071-4e89-bb94-a71268b9db9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032906 Apr 13 22:04:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 307/907] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:52 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:04:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:52 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:04:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-32ba00d4-80f0-4957-9a85-789ea8caa5d7 req-b02fa8f4-aa78-4994-bd4e-7f440301d737 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030019 Apr 13 22:04:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 301/908] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:04:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:04:54 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:04:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d805524d-a802-4971-95d6-afb85db55035 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1432 microversion: 2.1 time: 0.164053 Apr 13 22:04:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 301/909] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:04:54 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1432 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:08 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-aff66d2b-373a-43cd-9015-63707162551c tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1769 microversion: 2.87 time: 0.182665 Apr 13 22:05:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 308/910] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:05:08 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1769 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=16 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:32 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-09ede68b-22fc-46fc-b1b5-6ce1b94deb10 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1430 microversion: 2.1 time: 0.386462 Apr 13 22:05:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 302/911] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:31 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1430 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=18 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-14cfc7e4-25f3-4604-b910-23b3e5eb0cb9 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 200 len: 1442 microversion: 2.1 time: 0.631015 Apr 13 22:05:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 302/912] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:33 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 1442 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:36 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] Creating event network-changed:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:05:36 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-28583af5-30d3-4254-8c45-58b6fd6801e3 req-c9aca8c8-c63d-4fb1-be1f-e974331da464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 Apr 13 22:05:36 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 309/913] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:05:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5174669a-e668-48fc-aefd-ee698d48e1cf tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 204 len: 0 microversion: 2.1 time: 0.130990 Apr 13 22:05:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 303/914] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:05:36 2023] DELETE /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:36 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-82f9d3e4-6101-45d9-9a4f-f7ed5ce409b7 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 200 len: 1448 microversion: 2.1 time: 0.171941 Apr 13 22:05:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 303/915] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:36 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 1448 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "name": "network-vif-unplugged", "status": "completed", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}, {"server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "name": "network-vif-plugged", "status": "completed", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Creating event network-vif-unplugged:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:05:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] Creating event network-vif-plugged:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:05:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-49c088b1-cc83-4c70-bcdf-a668a21c400f req-c76aae48-7467-4d0c-a817-d364f868c0ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031041 Apr 13 22:05:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 310/916] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:38 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6cc27b-3d35-44e3-97dd-aac5a596d21c", "name": "network-vif-deleted", "tag": "71388612-8dc7-4935-b3d2-489e3d4b171e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] Creating event network-vif-deleted:71388612-8dc7-4935-b3d2-489e3d4b171e for instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c on user Apr 13 22:05:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3d2eed83-8a34-48c9-8a53-2b6f384a44e6 req-5af0c6e3-9aac-4f25-9da5-4467795c8d3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098012 Apr 13 22:05:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 304/917] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:39 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-00ef2fd3-3afe-49e4-9c55-7e48827f88dd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 200 len: 1537 microversion: 2.1 time: 0.149472 Apr 13 22:05:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 304/918] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:39 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] Creating event network-changed:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:05:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c9b24579-39fe-4e07-a8b1-055c02f8f5f0 req-240b77e4-1caa-4167-9dad-809458481e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030997 Apr 13 22:05:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 311/919] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23417134-71af-40e5-82a3-c491a40aee89"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d0d24169-3504-487f-a132-7ab51c38c21b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "POST /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390800 Apr 13 22:05:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 305/920] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:05:41 2023] POST /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d6ebfe12-060a-4e76-8cda-03e9b38dfd0c tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.209904 Apr 13 22:05:48 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 305/921] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:05:48 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-interface => generated 282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-acfcbf19-dcde-4e17-a86f-d3d05953ea28 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/ips" status: 200 len: 108 microversion: 2.1 time: 0.037531 Apr 13 22:05:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 306/922] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:05:49 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] Creating event network-changed:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:05:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-58f3590e-fbd1-4da3-a94b-b88ae09c0ed7 req-b2664d74-a71e-420c-9adb-cde6240fb814 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132631 Apr 13 22:05:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 312/923] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:50 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lazy-loading 'services' on Instance uuid 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:05:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b7beed5d-65ef-44c7-9e31-de78a0b72cac tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments/23417134-71af-40e5-82a3-c491a40aee89" status: 202 len: 0 microversion: 2.1 time: 0.198242 Apr 13 22:05:50 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 306/924] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:05:49 2023] DELETE /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments/23417134-71af-40e5-82a3-c491a40aee89 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-65005326-0f7c-4632-919f-6d411ab0d5fd tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068586 Apr 13 22:05:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 307/925] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:05:50 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f91dcd15-83a3-443c-a8b1-7952554a2b6e"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-578c9d34-394c-4d81-bde9-de57cb575532 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514866 Apr 13 22:05:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 313/926] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:05:50 2023] POST /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments => generated 194 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:54 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:54 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6a3c72af-1ab4-4372-a011-819331a938fb tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1432 microversion: 2.1 time: 0.241672 Apr 13 22:05:54 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 307/927] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:54 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1432 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:56 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lazy-loading 'flavor' on Instance uuid a70f4f57-2a18-4489-9f0d-e31e10d66fb0 {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:05:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-51393619-ef1f-4152-a1a7-7c16c30f1ef9 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/action" status: 202 len: 0 microversion: 2.1 time: 0.110763 Apr 13 22:05:56 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 314/928] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:05:56 2023] POST /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] Creating event network-changed:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:05:56 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-872de4b1-78f1-4e38-b458-941ff327ddbd req-8865171c-30a2-4161-876c-cb1260a349c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318967 Apr 13 22:05:56 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 308/929] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:56 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:05:56 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-57e61b12-43d4-4a6f-84e9-8e6b9c6141c6 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1438 microversion: 2.1 time: 0.227000 Apr 13 22:05:56 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 308/930] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:05:56 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1438 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-unplugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:56 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] Creating event network-vif-unplugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:05:56 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-31fc6e59-6fbf-4584-a181-fffb778b9a3c req-5bafa573-e06c-4520-877e-60d206d95e3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039940 Apr 13 22:05:56 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 315/931] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:58 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:58 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] Creating event network-changed:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:05:58 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-32827517-3f13-45f1-ae30-cebcd26a0c6f req-39dffb0a-8113-442f-9cbf-b5db6fe16e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031213 Apr 13 22:05:58 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 309/932] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:05:58 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:05:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:58 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:58 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:05:58 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-71e89cfe-f4a2-445e-b06f-dd0e3dd3e9fe req-66aaa2fb-8d8a-4280-8673-3779ee17565f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Apr 13 22:05:58 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 309/933] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:59 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lazy-loading 'services' on Instance uuid e568023a-3163-428f-8b1a-6c854c65f46f {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:05:59 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-66bc15d5-73a4-4657-8624-dab8cc3310ad tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments/f91dcd15-83a3-443c-a8b1-7952554a2b6e" status: 202 len: 0 microversion: 2.1 time: 0.175387 Apr 13 22:05:59 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 316/934] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:05:58 2023] DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments/f91dcd15-83a3-443c-a8b1-7952554a2b6e => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:05:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:05:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7860038d-c93e-4374-8b6f-347b72524fbd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054623 Apr 13 22:05:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 310/935] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:05:59 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=16 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:08 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:09 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:06:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6c99657d-4ce9-4dc6-b719-f9330f03ac9e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 204 len: 0 microversion: 2.87 time: 0.409473 Apr 13 22:06:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 310/936] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 22:06:08 2023] DELETE /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=16 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-unplugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:09 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:09 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-48601d6d-dfc9-428a-b519-bb632470ac5b tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 200 len: 1775 microversion: 2.87 time: 0.233981 Apr 13 22:06:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 317/937] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:06:09 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 1775 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:06:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] Creating event network-vif-unplugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:06:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3d6d7b71-fbbf-4c92-b511-8236aa761e1f req-5af23410-b0c0-4f8f-8cb4-eba98976b1ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045705 Apr 13 22:06:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 311/938] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:11 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-plugged", "status": "completed", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}, {"server_uuid": "e874e1c2-9dd4-4ca5-b273-abd35526d921", "name": "network-vif-deleted", "tag": "0b935ba6-4632-4032-8efd-bdb45a707797"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:11 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:11 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:11 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:11 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Creating event network-vif-plugged:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:06:11 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] Creating event network-vif-deleted:0b935ba6-4632-4032-8efd-bdb45a707797 for instance e874e1c2-9dd4-4ca5-b273-abd35526d921 on user Apr 13 22:06:11 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-80d46621-2b74-4bf1-8bc9-2dc4fd7df372 req-6b29b5d1-8585-4b88-ad6e-a7356543384b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030164 Apr 13 22:06:11 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 311/939] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:06:26 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c HTTP/1.1 Apr 13 22:06:26 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:06:26 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:06:26 user devstack@n-api.service[61664]: Connection: close Apr 13 22:06:26 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:06:26 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:06:26 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:06:26 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:06:26 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:06:26 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:06:26 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:06:26 user devstack@n-api.service[61664]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:06:26 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:06:26 user devstack@n-api.service[61664]: method: > Apr 13 22:06:26 user devstack@n-api.service[61664]: exception: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:06:26 user devstack@n-api.service[61664]: action_args: {'id': 'fc6cc27b-3d35-44e3-97dd-aac5a596d21c'} Apr 13 22:06:26 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:06:26 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:06:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:06:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0502519f-4d7b-4d6b-a552-8b0ff6110e49 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 404 len: 111 microversion: 2.1 time: 0.036648 Apr 13 22:06:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 318/940] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:26 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:06:26 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2080693904", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-949568181", "security_groups": [{"name": "tempest-secgroup-smoke-1800243154"}], "block_device_mapping_v2": [{"uuid": "5fa56af9-4ad3-47b4-8234-7ad286b5647f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:06:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5fa56af9-4ad3-47b4-8234-7ad286b5647f',volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:06:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-7e005ed0-39a0-4723-9ced-31d9558323aa tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.786750 Apr 13 22:06:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 312/941] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:06:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:06:27 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-4a681e13-eb69-4511-8a15-84613c02dbe2 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:27 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-4a681e13-eb69-4511-8a15-84613c02dbe2 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:27 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:27 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-4a681e13-eb69-4511-8a15-84613c02dbe2 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-4a681e13-eb69-4511-8a15-84613c02dbe2 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 200 len: 1089 microversion: 2.1 time: 0.080619 Apr 13 22:06:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 312/942] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:27 2023] GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 1089 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:06:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] Creating event network-changed:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:06:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9e14ba82-6a2d-4406-a6e1-b9a17628e54f req-3db36252-bf94-47da-8009-d62709f83896 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040055 Apr 13 22:06:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 319/943] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5df686f1-4f17-4f0c-9a2c-4ea080707663 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.106960 Apr 13 22:06:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 313/944] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:06:32 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] Creating event network-changed:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:06:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-2d37f6a1-da8e-4ba4-844a-f0d646ccb111 req-8c8fa303-0ac2-442c-983b-89bc1ab6b659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037115 Apr 13 22:06:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 313/945] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fe82e3ec-c1e6-47db-913b-eee31d0f9ae5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1430 microversion: 2.1 time: 0.239626 Apr 13 22:06:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 320/946] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:33 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1430 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Old instance type m1.nano, new instance type m1.micro {{(pid=61663) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for project 7c086cffbafb4da68f172ab27da232d3. Resources: {'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:06:33 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Getting quotas for user b3db8b01a05b43f68bfd8695253514db and project 7c086cffbafb4da68f172ab27da232d3. Resources: {'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:06:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:06:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:06:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:06:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:06:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:06:34 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a6a42d51-1550-441a-8a03-0f9def8d2a4c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action" status: 202 len: 0 microversion: 2.1 time: 0.280993 Apr 13 22:06:34 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 314/947] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:06:33 2023] POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:34 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:34 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-2f593bdc-20ac-4fab-854c-eec907a10db8 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1439 microversion: 2.1 time: 0.191236 Apr 13 22:06:34 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 314/948] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:34 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1439 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:06:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Creating event network-changed:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:06:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] Instance 03027926-4eef-4af8-afca-b70f625de6ab is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61664) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 22:06:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5d472c99-da7e-4745-b3d0-e2e70192efb5 req-51960a6d-55ad-4edf-b0ab-39d6a917fb2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043326 Apr 13 22:06:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 321/949] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-unplugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Creating event network-vif-unplugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:06:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] Instance 03027926-4eef-4af8-afca-b70f625de6ab is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61663) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 22:06:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-8c4fcf82-54f3-4a30-8a87-cbb710191bdb req-fce15cc2-3575-4a64-b148-30e41a264640 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034616 Apr 13 22:06:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 315/950] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}, {"server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "name": "network-vif-plugged", "status": "completed", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}, {"server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "name": "network-vif-plugged", "status": "completed", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:06:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Creating event network-vif-plugged:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:06:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Creating event network-vif-plugged:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:06:38 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] Instance 03027926-4eef-4af8-afca-b70f625de6ab is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 22:06:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-15fe52e1-1cfe-474c-a211-7cb003ce9008 req-fc42e860-5ce2-47d5-ae63-6bce719061a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052434 Apr 13 22:06:38 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 315/951] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0df8d3b1-f8b7-494a-84ac-b856f326d642 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055854 Apr 13 22:06:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 322/952] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:06:40 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] Creating event network-changed:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:06:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-972b25f9-446a-4a4a-8a9c-037a8919cbb8 req-a653b34d-6fed-4ca1-9572-c29bba73f699 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035944 Apr 13 22:06:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 316/953] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:41 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:06:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-142488aa-59ae-4a4a-a2ce-6670957fd3af tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 204 len: 0 microversion: 2.1 time: 0.146541 Apr 13 22:06:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 316/954] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:06:41 2023] DELETE /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:41 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c1c1b605-62e4-4c66-b108-4271aa1bff3b tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 200 len: 1661 microversion: 2.1 time: 0.274487 Apr 13 22:06:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 323/955] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:41 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 1661 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:06:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "name": "network-vif-deleted", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] Creating event network-vif-deleted:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:06:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-66b6d044-0630-4360-aea7-cff815f82321 req-17b3fe34-dbe1-4495-a03c-e345ea590e3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095589 Apr 13 22:06:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 317/956] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "name": "network-vif-unplugged", "status": "completed", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}, {"server_uuid": "940ee3fc-f7d5-4f22-a3c8-6e4e15018b78", "name": "network-vif-plugged", "status": "completed", "tag": "2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Creating event network-vif-unplugged:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:06:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] Creating event network-vif-plugged:2ee4b50e-d292-4fa5-ae89-ae70d2ba46fb for instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 on user Apr 13 22:06:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-3cb4b0b1-e3df-4c59-8708-d8da7a1c85f2 req-bdc689aa-ef60-4102-9e1b-49c4a34cf4b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.050157 Apr 13 22:06:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 317/957] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:47 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:47 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-065e275c-a158-403b-bae9-3e30102e670a tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1498 microversion: 2.1 time: 0.180626 Apr 13 22:06:47 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 324/958] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:46 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:06:47 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:06:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] Instance 03027926-4eef-4af8-afca-b70f625de6ab is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 22:06:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-672b8c84-bffa-45d3-a1d0-4f6644fa6ccd req-78edf4e5-a29f-400f-9510-e32840f9be32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039234 Apr 13 22:06:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 318/959] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=5 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3a1ad7e3-a1ba-466a-a336-74f3bbaf9ffd tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079749 Apr 13 22:06:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 318/960] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:06:49 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:06:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] Instance 03027926-4eef-4af8-afca-b70f625de6ab is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61665) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 13 22:06:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-2d309c9b-2b60-40b7-a568-69e54b20ef73 req-7cffad97-f038-4a86-8645-6865dc460f43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039926 Apr 13 22:06:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 319/961] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e40e07ff-af1e-4ef1-a760-1aa4584f9cfb tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 204 len: 0 microversion: 2.1 time: 0.151757 Apr 13 22:06:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 325/962] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:06:49 2023] DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145c0a177fcc4b94b5480d8806554ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446b51db737947ab9bddd5fc47488bc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:06:49 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-40fae21e-e32f-4613-bcf7-2447600600e7 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 200 len: 1667 microversion: 2.1 time: 0.256279 Apr 13 22:06:49 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 319/963] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:06:49 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 1667 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "name": "network-vif-unplugged", "status": "completed", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] Creating event network-vif-unplugged:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:06:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-ea693d5b-6de1-414b-b551-20ddd38ae340 req-29c2d2e2-fe95-4979-bf4c-d65c974367c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029279 Apr 13 22:06:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 320/964] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "name": "network-vif-plugged", "status": "completed", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}, {"server_uuid": "e568023a-3163-428f-8b1a-6c854c65f46f", "name": "network-vif-deleted", "tag": "45ea22f6-3663-4d12-a479-41c56f1e9bc2"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:06:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Creating event network-vif-plugged:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:06:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] Creating event network-vif-deleted:45ea22f6-3663-4d12-a479-41c56f1e9bc2 for instance e568023a-3163-428f-8b1a-6c854c65f46f on user Apr 13 22:06:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-90c42c69-721d-4838-83b4-197e142f105f req-3fca2f50-70d6-46a1-b32c-a7e71e912e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034169 Apr 13 22:06:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 326/965] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:06:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: e874e1c2-9dd4-4ca5-b273-abd35526d921] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HTTP exception thrown: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Request method failure captured: Apr 13 22:06:59 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 HTTP/1.1 Apr 13 22:06:59 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:06:59 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:06:59 user devstack@n-api.service[61663]: Connection: close Apr 13 22:06:59 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:06:59 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:06:59 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:06:59 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:06:59 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHjPowYAKsfrugQUyyaOQdyOuc8JMoC9zxSczWOZpS8iJ5jiIRNRIxqRqHtighf6ijg_yow_-4cF4lEv6hFTLyQ_1zj-S_Kplh3PIVs1J4JE9w4tiTJKd11EVqGErzn7gQswmNpXzUNV1zBoUfPbh6kDP-8HTtk68Qb5DY_Sq91HCNI Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Project-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Tenant-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-User: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:06:59 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:06:59 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:06:59 user devstack@n-api.service[61663]: X-User-Id: 0ab740920cac4befac62a72f7ce5a817 Apr 13 22:06:59 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:06:59 user devstack@n-api.service[61663]: method: > Apr 13 22:06:59 user devstack@n-api.service[61663]: exception: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. Apr 13 22:06:59 user devstack@n-api.service[61663]: action_args: {'id': 'e874e1c2-9dd4-4ca5-b273-abd35526d921'} Apr 13 22:06:59 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. Apr 13 22:06:59 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:06:59 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Returning 404 to user: Instance e874e1c2-9dd4-4ca5-b273-abd35526d921 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:06:59 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-08054fc5-1b81-4ae2-9df4-16dd57fb42a8 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921" status: 404 len: 111 microversion: 2.87 time: 0.037689 Apr 13 22:06:59 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 320/966] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:06:59 2023] GET /compute/v2.1/servers/e874e1c2-9dd4-4ca5-b273-abd35526d921 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=21 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=27 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:06:59 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:06:59 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-0bb97c03-47a8-440f-8279-f0e0588bbf99 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 204 len: 0 microversion: 2.87 time: 0.134212 Apr 13 22:06:59 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 321/967] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 22:06:59 2023] DELETE /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:00 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:00 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-7e12efef-a185-4027-86d7-8e43f237b74e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 200 len: 1697 microversion: 2.87 time: 0.289264 Apr 13 22:07:00 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 327/968] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:06:59 2023] GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 1697 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:07:00 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "name": "network-vif-unplugged", "status": "completed", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:00 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] Creating event network-vif-unplugged:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 22:07:00 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-455fdeb7-888d-45bf-9f87-d17c7db8e24b req-180f2b13-6556-4b58-9d39-de72a4ca3dcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030415 Apr 13 22:07:00 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 321/969] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:01 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "name": "network-vif-deleted", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:01 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] Creating event network-vif-deleted:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 22:07:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-fc28757d-6989-4d4c-8ccf-4baedcded2be req-5e527df3-715e-4dcd-ac31-582201e34401 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032092 Apr 13 22:07:01 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 322/970] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:02 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcfa307-25f3-43e0-837b-704b5cd7783f", "name": "network-vif-plugged", "status": "completed", "tag": "67f4855a-44cd-42ff-87f6-9f0704b9960a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:02 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] Creating event network-vif-plugged:67f4855a-44cd-42ff-87f6-9f0704b9960a for instance bfcfa307-25f3-43e0-837b-704b5cd7783f on user Apr 13 22:07:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e303d0f9-2afb-45a9-8694-82c26b4e0cd6 req-76759ed3-1f99-47df-8ca5-ae300e8197a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132842 Apr 13 22:07:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 328/971] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d44321c8-4f1b-44cb-80b1-0b9c802e0ca1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 200 len: 1442 microversion: 2.1 time: 0.155528 Apr 13 22:07:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 322/972] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:17 2023] GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:24 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:24 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5d0a7988-9d2b-4d46-92cd-5565bc86e89a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1557 microversion: 2.1 time: 0.165444 Apr 13 22:07:24 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 323/973] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:24 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=5 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=7 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] HTTP exception thrown: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Request method failure captured: Apr 13 22:07:31 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 HTTP/1.1 Apr 13 22:07:31 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:07:31 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:07:31 user devstack@n-api.service[61664]: Connection: close Apr 13 22:07:31 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:07:31 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:07:31 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:07:31 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:07:31 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHuBNkkHpm1MpPd0Bv5-wfm5B3X3TSxFE-TNr-U3czqrsYrjT-ldTRmQCx0dO7v_L9nidVvwFPKnN6ds0uTYdS6HIIHkz-B7O5DZZYzqkQ_JvywDJ1C8CXTtpF679h5YF_fO5-uzNNOPCm_Wcpti8O_CnaVDa8RjAMt7JN3lKutb3vQ Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Project-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestStampPattern-921591052 Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Tenant: tempest-TestStampPattern-921591052 Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Tenant-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:07:31 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestStampPattern-921591052 Apr 13 22:07:31 user devstack@n-api.service[61664]: X-User: tempest-TestStampPattern-921591052-project-member Apr 13 22:07:31 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:07:31 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:07:31 user devstack@n-api.service[61664]: X-User-Id: 26fb3ecc54c84118b2100ff89cbc87f6 Apr 13 22:07:31 user devstack@n-api.service[61664]: X-User-Name: tempest-TestStampPattern-921591052-project-member Apr 13 22:07:31 user devstack@n-api.service[61664]: method: > Apr 13 22:07:31 user devstack@n-api.service[61664]: exception: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. Apr 13 22:07:31 user devstack@n-api.service[61664]: action_args: {'id': '940ee3fc-f7d5-4f22-a3c8-6e4e15018b78'} Apr 13 22:07:31 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. Apr 13 22:07:31 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:31 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Returning 404 to user: Instance 940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:31 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-142657f6-affc-4d57-99d6-fcda35bfdb95 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78" status: 404 len: 111 microversion: 2.1 time: 0.033238 Apr 13 22:07:31 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 329/974] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:31 2023] GET /compute/v2.1/servers/940ee3fc-f7d5-4f22-a3c8-6e4e15018b78 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] HTTP exception thrown: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 is not attached to volume a790c3c4-c019-4667-acd2-5fd9108e7fdd Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Request method failure captured: Apr 13 22:07:36 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments/a790c3c4-c019-4667-acd2-5fd9108e7fdd HTTP/1.1 Apr 13 22:07:36 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:07:36 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:07:36 user devstack@n-api.service[61663]: Connection: close Apr 13 22:07:36 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:07:36 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:07:36 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:07:36 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:07:36 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHuBNkkHpm1MpPd0Bv5-wfm5B3X3TSxFE-TNr-U3czqrsYrjT-ldTRmQCx0dO7v_L9nidVvwFPKnN6ds0uTYdS6HIIHkz-B7O5DZZYzqkQ_JvywDJ1C8CXTtpF679h5YF_fO5-uzNNOPCm_Wcpti8O_CnaVDa8RjAMt7JN3lKutb3vQ Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Project-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestStampPattern-921591052 Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Tenant: tempest-TestStampPattern-921591052 Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Tenant-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:07:36 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestStampPattern-921591052 Apr 13 22:07:36 user devstack@n-api.service[61663]: X-User: tempest-TestStampPattern-921591052-project-member Apr 13 22:07:36 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:07:36 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:07:36 user devstack@n-api.service[61663]: X-User-Id: 26fb3ecc54c84118b2100ff89cbc87f6 Apr 13 22:07:36 user devstack@n-api.service[61663]: X-User-Name: tempest-TestStampPattern-921591052-project-member Apr 13 22:07:36 user devstack@n-api.service[61663]: method: > Apr 13 22:07:36 user devstack@n-api.service[61663]: exception: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 is not attached to volume a790c3c4-c019-4667-acd2-5fd9108e7fdd Apr 13 22:07:36 user devstack@n-api.service[61663]: action_args: {'server_id': '061e133a-9d17-4ff9-839a-235b05f9dd93', 'id': 'a790c3c4-c019-4667-acd2-5fd9108e7fdd'} Apr 13 22:07:36 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a790c3c4-c019-4667-acd2-5fd9108e7fdd. Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 is not attached to volume a790c3c4-c019-4667-acd2-5fd9108e7fdd Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 is not attached to volume a790c3c4-c019-4667-acd2-5fd9108e7fdd Apr 13 22:07:36 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:36 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Returning 404 to user: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 is not attached to volume a790c3c4-c019-4667-acd2-5fd9108e7fdd {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:36 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f0c049cb-84ed-4bc1-973f-0bc64b6fbe3d tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments/a790c3c4-c019-4667-acd2-5fd9108e7fdd" status: 404 len: 154 microversion: 2.1 time: 0.093374 Apr 13 22:07:36 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 323/975] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:07:36 2023] DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93/os-volume_attachments/a790c3c4-c019-4667-acd2-5fd9108e7fdd => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:37 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:37 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] Creating event network-changed:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:07:37 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-31d061c4-10ae-41c9-a199-a39034b78494 req-7fe40e4c-dfa6-400c-8280-2f821f810c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Apr 13 22:07:37 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 330/976] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:37 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Going to try to terminate instance {{(pid=61665) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:07:37 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-5f8c69da-30d4-491e-b127-1b3ff6def4fe tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 204 len: 0 microversion: 2.1 time: 0.159324 Apr 13 22:07:37 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:07:37 2023] DELETE /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:37 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26fb3ecc54c84118b2100ff89cbc87f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388f228079fa45cb91fa08b972132fbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-203ca279-2ad2-44ba-ba9d-51778e3dd61e tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 200 len: 1661 microversion: 2.1 time: 0.266709 Apr 13 22:07:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 324/978] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:37 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 1661 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:07:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "name": "network-vif-deleted", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] Creating event network-vif-deleted:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:07:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-81e5c55c-58c3-4719-b83c-3be00b5134f0 req-29e0f5ce-28ea-4387-9797-cb8b7e36ba0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Apr 13 22:07:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 331/979] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:39 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "name": "network-vif-unplugged", "status": "completed", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}, {"server_uuid": "061e133a-9d17-4ff9-839a-235b05f9dd93", "name": "network-vif-plugged", "status": "completed", "tag": "f00a6c25-29d8-4444-8128-ba174833d8fe"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Creating event network-vif-unplugged:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:07:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] Creating event network-vif-plugged:f00a6c25-29d8-4444-8128-ba174833d8fe for instance 061e133a-9d17-4ff9-839a-235b05f9dd93 on user Apr 13 22:07:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-945d0949-94cb-425e-9062-c9711d6a9ca6 req-b49a14e7-50b8-4bbc-ae3b-f40f60a3b957 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033596 Apr 13 22:07:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 325/980] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:39 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f HTTP/1.1 Apr 13 22:07:39 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:07:39 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:07:39 user devstack@n-api.service[61663]: Connection: close Apr 13 22:07:39 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:07:39 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:07:39 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:07:39 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:07:39 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:39 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:07:39 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:07:39 user devstack@n-api.service[61663]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:39 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:39 user devstack@n-api.service[61663]: method: > Apr 13 22:07:39 user devstack@n-api.service[61663]: exception: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:39 user devstack@n-api.service[61663]: action_args: {'id': 'e568023a-3163-428f-8b1a-6c854c65f46f'} Apr 13 22:07:39 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:39 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:39 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-37672bbd-8936-44d9-a8aa-17b02f3f3144 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 404 len: 111 microversion: 2.1 time: 0.032055 Apr 13 22:07:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 325/981] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:39 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e98f4c33-01ed-442f-8f4d-b928d0cd5f8f tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '.version_select at 0x7f4b3ceab640>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e98f4c33-01ed-442f-8f4d-b928d0cd5f8f tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-548852854" status: 202 len: 0 microversion: 2.1 time: 0.022703 Apr 13 22:07:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 332/982] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:07:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-548852854 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:43 user devstack@n-api.service[61665]: request: DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f HTTP/1.1 Apr 13 22:07:43 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:07:43 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:07:43 user devstack@n-api.service[61665]: Connection: close Apr 13 22:07:43 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:07:43 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:07:43 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:07:43 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:07:43 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:43 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:07:43 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:07:43 user devstack@n-api.service[61665]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:43 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:43 user devstack@n-api.service[61665]: method: > Apr 13 22:07:43 user devstack@n-api.service[61665]: exception: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61665]: action_args: {'id': 'e568023a-3163-428f-8b1a-6c854c65f46f'} Apr 13 22:07:43 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-cfac85b6-4af0-49a0-b391-9d28963fc773 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 404 len: 111 microversion: 2.1 time: 0.036687 Apr 13 22:07:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 326/983] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:07:43 2023] DELETE /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: e568023a-3163-428f-8b1a-6c854c65f46f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:43 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f HTTP/1.1 Apr 13 22:07:43 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:07:43 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:07:43 user devstack@n-api.service[61663]: Connection: close Apr 13 22:07:43 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:07:43 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:07:43 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:07:43 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:07:43 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:43 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:07:43 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:07:43 user devstack@n-api.service[61663]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:43 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:43 user devstack@n-api.service[61663]: method: > Apr 13 22:07:43 user devstack@n-api.service[61663]: exception: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61663]: action_args: {'id': 'e568023a-3163-428f-8b1a-6c854c65f46f'} Apr 13 22:07:43 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. Apr 13 22:07:43 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:43 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance e568023a-3163-428f-8b1a-6c854c65f46f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:43 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-914f777a-62c1-45ef-919e-5ceee65620de tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f" status: 404 len: 111 microversion: 2.1 time: 0.032364 Apr 13 22:07:43 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 326/984] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:43 2023] GET /compute/v2.1/servers/e568023a-3163-428f-8b1a-6c854c65f46f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:46 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b HTTP/1.1 Apr 13 22:07:46 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:07:46 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:07:46 user devstack@n-api.service[61664]: Connection: close Apr 13 22:07:46 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:07:46 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:07:46 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:07:46 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:07:46 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61664]: method: > Apr 13 22:07:46 user devstack@n-api.service[61664]: exception: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: action_args: {'id': '37c5f603-6f39-4fc7-a86e-be1b6cebde5b'} Apr 13 22:07:46 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-141356d8-01f4-4dda-85a2-81aa5941b0c8 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 404 len: 111 microversion: 2.1 time: 0.029143 Apr 13 22:07:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 333/985] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:07:46 2023] DELETE /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 37c5f603-6f39-4fc7-a86e-be1b6cebde5b] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:46 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b HTTP/1.1 Apr 13 22:07:46 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:07:46 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:07:46 user devstack@n-api.service[61665]: Connection: close Apr 13 22:07:46 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:07:46 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:07:46 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:07:46 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:07:46 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61665]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:46 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61665]: method: > Apr 13 22:07:46 user devstack@n-api.service[61665]: exception: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61665]: action_args: {'id': '37c5f603-6f39-4fc7-a86e-be1b6cebde5b'} Apr 13 22:07:46 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. Apr 13 22:07:46 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 37c5f603-6f39-4fc7-a86e-be1b6cebde5b could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:46 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8287d783-6441-475d-9f74-e9cb49d7b3dc tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b" status: 404 len: 111 microversion: 2.1 time: 0.036502 Apr 13 22:07:46 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 327/986] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:46 2023] GET /compute/v2.1/servers/37c5f603-6f39-4fc7-a86e-be1b6cebde5b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:46 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 HTTP/1.1 Apr 13 22:07:46 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:07:46 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:07:46 user devstack@n-api.service[61663]: Connection: close Apr 13 22:07:46 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:07:46 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:07:46 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:07:46 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:07:46 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61663]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:46 user devstack@n-api.service[61663]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61663]: method: > Apr 13 22:07:46 user devstack@n-api.service[61663]: exception: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61663]: action_args: {'id': '9c729f61-da40-49d7-8f93-d9bbe30fa877'} Apr 13 22:07:46 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f3e30d9f-9713-46db-9d0a-22dbd63077ca tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 404 len: 111 microversion: 2.1 time: 0.027859 Apr 13 22:07:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 327/987] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:07:46 2023] DELETE /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 9c729f61-da40-49d7-8f93-d9bbe30fa877] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:46 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 HTTP/1.1 Apr 13 22:07:46 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:07:46 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:07:46 user devstack@n-api.service[61664]: Connection: close Apr 13 22:07:46 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:07:46 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:07:46 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:07:46 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:07:46 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:46 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:46 user devstack@n-api.service[61664]: method: > Apr 13 22:07:46 user devstack@n-api.service[61664]: exception: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: action_args: {'id': '9c729f61-da40-49d7-8f93-d9bbe30fa877'} Apr 13 22:07:46 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. Apr 13 22:07:46 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:46 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 9c729f61-da40-49d7-8f93-d9bbe30fa877 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:46 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1f74eb9d-a128-49f2-9362-e1447ba1369e tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877" status: 404 len: 111 microversion: 2.1 time: 0.026916 Apr 13 22:07:46 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 334/988] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:46 2023] GET /compute/v2.1/servers/9c729f61-da40-49d7-8f93-d9bbe30fa877 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:47 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61665) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 13 22:07:47 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-418ff2b9-5779-4baf-a832-92426f61ac40 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/action" status: 202 len: 0 microversion: 2.1 time: 0.196779 Apr 13 22:07:47 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 328/989] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:07:47 2023] POST /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:47 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:47 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-82849959-9685-4352-b776-e07f8b6c96b5 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1506 microversion: 2.1 time: 0.212188 Apr 13 22:07:47 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 328/990] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:47 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:49 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 HTTP/1.1 Apr 13 22:07:49 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:07:49 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:07:49 user devstack@n-api.service[61664]: Connection: close Apr 13 22:07:49 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:07:49 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:07:49 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:07:49 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:07:49 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:49 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:07:49 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:07:49 user devstack@n-api.service[61664]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:49 user devstack@n-api.service[61664]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:49 user devstack@n-api.service[61664]: method: > Apr 13 22:07:49 user devstack@n-api.service[61664]: exception: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61664]: action_args: {'id': '78b584a2-7dbc-4793-9d93-37897f9a24b1'} Apr 13 22:07:49 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:49 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-24ea1fea-b13e-493f-a109-3e920c5ed668 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 404 len: 111 microversion: 2.1 time: 0.038101 Apr 13 22:07:49 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 335/991] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:07:49 2023] DELETE /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] [instance: 78b584a2-7dbc-4793-9d93-37897f9a24b1] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] HTTP exception thrown: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Request method failure captured: Apr 13 22:07:49 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 HTTP/1.1 Apr 13 22:07:49 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:07:49 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:07:49 user devstack@n-api.service[61665]: Connection: close Apr 13 22:07:49 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:07:49 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:07:49 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:07:49 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:07:49 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHnf7ECK3yFpdNZAlIOpWwJ630y2Dhxt6gMgmcli9c5REX3J6C_5A2BjPKI4W6v_KV6U64HO63jg8kBqIUjfhI3GKe5pIN5XsohKI71A7N3zah13FRI5L_DW46nhTzyi3QFq5eUdqd-lxteju9yABdfHlpsIlNGyuFGcs4u1As4262c Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Project-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Project-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/446b51db737947ab9bddd5fc47488bc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Tenant: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Tenant-Id: 446b51db737947ab9bddd5fc47488bc7 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920375840 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-User: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:49 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:07:49 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:07:49 user devstack@n-api.service[61665]: X-User-Id: 145c0a177fcc4b94b5480d8806554ac9 Apr 13 22:07:49 user devstack@n-api.service[61665]: X-User-Name: tempest-AttachVolumeNegativeTest-920375840-project-member Apr 13 22:07:49 user devstack@n-api.service[61665]: method: > Apr 13 22:07:49 user devstack@n-api.service[61665]: exception: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61665]: action_args: {'id': '78b584a2-7dbc-4793-9d93-37897f9a24b1'} Apr 13 22:07:49 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. Apr 13 22:07:49 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:07:49 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] Returning 404 to user: Instance 78b584a2-7dbc-4793-9d93-37897f9a24b1 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:49 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6849e280-6290-4f10-a32a-e6aedcb929e4 tempest-AttachVolumeNegativeTest-920375840 tempest-AttachVolumeNegativeTest-920375840-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1" status: 404 len: 111 microversion: 2.1 time: 0.031307 Apr 13 22:07:49 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 329/992] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:07:49 2023] GET /compute/v2.1/servers/78b584a2-7dbc-4793-9d93-37897f9a24b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: bfcfa307-25f3-43e0-837b-704b5cd7783f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HTTP exception thrown: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Request method failure captured: Apr 13 22:07:50 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f HTTP/1.1 Apr 13 22:07:50 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:07:50 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:07:50 user devstack@n-api.service[61663]: Connection: close Apr 13 22:07:50 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:07:50 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:07:50 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:07:50 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:07:50 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHjPowYAKsfrugQUyyaOQdyOuc8JMoC9zxSczWOZpS8iJ5jiIRNRIxqRqHtighf6ijg_yow_-4cF4lEv6hFTLyQ_1zj-S_Kplh3PIVs1J4JE9w4tiTJKd11EVqGErzn7gQswmNpXzUNV1zBoUfPbh6kDP-8HTtk68Qb5DY_Sq91HCNI Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Project-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Tenant-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-User: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:07:50 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:07:50 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:07:50 user devstack@n-api.service[61663]: X-User-Id: 0ab740920cac4befac62a72f7ce5a817 Apr 13 22:07:50 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:07:50 user devstack@n-api.service[61663]: method: > Apr 13 22:07:50 user devstack@n-api.service[61663]: exception: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. Apr 13 22:07:50 user devstack@n-api.service[61663]: action_args: {'id': 'bfcfa307-25f3-43e0-837b-704b5cd7783f'} Apr 13 22:07:50 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. Apr 13 22:07:50 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Returning 404 to user: Instance bfcfa307-25f3-43e0-837b-704b5cd7783f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:07:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3facd5e1-1e3c-4651-bce5-a4af7b874587 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f" status: 404 len: 111 microversion: 2.87 time: 0.047123 Apr 13 22:07:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 329/993] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:07:50 2023] GET /compute/v2.1/servers/bfcfa307-25f3-43e0-837b-704b5cd7783f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:07:50 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-bd5d4234-8484-47c2-9996-f7e62778b4e7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 204 len: 0 microversion: 2.87 time: 0.115013 Apr 13 22:07:50 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 336/994] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 22:07:50 2023] DELETE /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:50 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:07:50 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e8f1ee6c-8b07-44c2-b3d7-61447aef70a7 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 200 len: 1775 microversion: 2.87 time: 0.304317 Apr 13 22:07:50 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 330/995] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:07:50 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 1775 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-unplugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:50 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] Creating event network-vif-unplugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 22:07:50 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-48030271-fcf2-4502-b3d2-c28753143c6b req-4d1f3722-1610-4e60-a7f6-3b460af66692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034751 Apr 13 22:07:50 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 330/996] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:52 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-deleted", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:52 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] Creating event network-vif-deleted:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 22:07:52 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-c96338f6-e5c7-4d9a-a77a-fef10437a49d req-f6c2424b-62d7-4181-b68f-32add63b7a0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045775 Apr 13 22:07:52 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 337/997] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:53 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fbf2022-b069-440f-8513-6d107f0a7180", "name": "network-vif-plugged", "status": "completed", "tag": "fee95846-6886-4a1a-b7cb-53bd1c1977d8"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:53 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] Creating event network-vif-plugged:fee95846-6886-4a1a-b7cb-53bd1c1977d8 for instance 6fbf2022-b069-440f-8513-6d107f0a7180 on user Apr 13 22:07:53 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-91aa9c3d-069e-48a3-a285-48ec08d9da51 req-832a6d3c-a00d-4aaf-879b-90dc482fcbcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039162 Apr 13 22:07:53 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 331/998] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] Creating event network-changed:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:07:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4e0bb747-a5fd-4995-8a00-347fbf284f40 req-f10bf76c-b427-4c69-b0b2-877606b5e82e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Apr 13 22:07:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 331/999] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:07:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.053s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:07:58 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:07:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-dedf8eeb-ea0d-403a-94c0-c0aa422293d7 req-790e33aa-8476-4b89-b7a6-4d4dbc2a54c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233560 Apr 13 22:07:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 338/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:07:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:00 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:00 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:08:00 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-57c14e74-029c-4e58-aac2-762e344d6600 req-bbedbe45-cf11-4f56-873b-60a757af3902 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040200 Apr 13 22:08:00 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 332/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=18 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=30 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:18 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-e30457b4-527f-4f40-9323-1273e3d8e770 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 200 len: 1442 microversion: 2.1 time: 0.158204 Apr 13 22:08:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 332/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:18 2023] GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] Creating event network-changed:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:08:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-562d31e7-21b4-409b-a2e0-ea194bab500a req-10bfbf3b-d88b-49f0-8a94-946693db80b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042534 Apr 13 22:08:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 339/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:24 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:24 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-56481093-4927-47a8-8f0e-4be01e98e82c tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action" status: 204 len: 0 microversion: 2.1 time: 0.101402 Apr 13 22:08:24 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 333/1004] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:08:24 2023] POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:24 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:24 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-edd8adc9-b95c-46cd-b98f-16ae60470f44 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1557 microversion: 2.1 time: 0.154078 Apr 13 22:08:24 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 333/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:24 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1525616194", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-949568181", "security_groups": [{"name": "tempest-secgroup-smoke-1800243154"}], "block_device_mapping_v2": [{"uuid": "dd3498e9-9800-4320-bd74-8a7f1929465d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d6054eb9-3a31-4839-954a-018b5b09e633"}]}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.network.neutron [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] validate_networks() for [('d6054eb9-3a31-4839-954a-018b5b09e633', None, None, None, None, None)] {{(pid=61664) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image limits 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Flavor pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Image pref 0:0:0 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.virt.hardware [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61664) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Getting quotas for user 50a8a5f433c94e0c9ba4d6ecea37d756 and project ad824150d99044c6ab1c7829cbe01de5. Resources: {'instances', 'cores', 'ram'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Going to run 1 instances... {{(pid=61664) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:08:26 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd3498e9-9800-4320-bd74-8a7f1929465d',volume_size=None,volume_type=None)] {{(pid=61664) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:08:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-5d635c23-4434-42dd-9067-97ce2530390a tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.812713 Apr 13 22:08:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 340/1006] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:08:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:08:26 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-cc6d0939-7895-4dd9-82c2-426cc8f8f6e0 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:26 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-cc6d0939-7895-4dd9-82c2-426cc8f8f6e0 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:27 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-cc6d0939-7895-4dd9-82c2-426cc8f8f6e0 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:27 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-cc6d0939-7895-4dd9-82c2-426cc8f8f6e0 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 200 len: 1089 microversion: 2.1 time: 0.066648 Apr 13 22:08:27 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 334/1007] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:26 2023] GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] [instance: 061e133a-9d17-4ff9-839a-235b05f9dd93] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] HTTP exception thrown: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Request method failure captured: Apr 13 22:08:27 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 HTTP/1.1 Apr 13 22:08:27 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:08:27 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:08:27 user devstack@n-api.service[61663]: Connection: close Apr 13 22:08:27 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:08:27 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:08:27 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:08:27 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:08:27 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHuBNkkHpm1MpPd0Bv5-wfm5B3X3TSxFE-TNr-U3czqrsYrjT-ldTRmQCx0dO7v_L9nidVvwFPKnN6ds0uTYdS6HIIHkz-B7O5DZZYzqkQ_JvywDJ1C8CXTtpF679h5YF_fO5-uzNNOPCm_Wcpti8O_CnaVDa8RjAMt7JN3lKutb3vQ Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Project-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestStampPattern-921591052 Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/388f228079fa45cb91fa08b972132fbe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Tenant: tempest-TestStampPattern-921591052 Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Tenant-Id: 388f228079fa45cb91fa08b972132fbe Apr 13 22:08:27 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestStampPattern-921591052 Apr 13 22:08:27 user devstack@n-api.service[61663]: X-User: tempest-TestStampPattern-921591052-project-member Apr 13 22:08:27 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:08:27 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:08:27 user devstack@n-api.service[61663]: X-User-Id: 26fb3ecc54c84118b2100ff89cbc87f6 Apr 13 22:08:27 user devstack@n-api.service[61663]: X-User-Name: tempest-TestStampPattern-921591052-project-member Apr 13 22:08:27 user devstack@n-api.service[61663]: method: > Apr 13 22:08:27 user devstack@n-api.service[61663]: exception: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. Apr 13 22:08:27 user devstack@n-api.service[61663]: action_args: {'id': '061e133a-9d17-4ff9-839a-235b05f9dd93'} Apr 13 22:08:27 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. Apr 13 22:08:27 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:08:27 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Returning 404 to user: Instance 061e133a-9d17-4ff9-839a-235b05f9dd93 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:08:27 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-d73d63af-ad94-4c2b-970b-bd8e984d271a tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93" status: 404 len: 111 microversion: 2.1 time: 0.034305 Apr 13 22:08:27 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 334/1008] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:27 2023] GET /compute/v2.1/servers/061e133a-9d17-4ff9-839a-235b05f9dd93 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:08:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] Creating event network-changed:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:08:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-bd0382ed-d080-4a12-b93b-721da24f73c1 req-eb71f007-9141-4e08-a740-2992d1336c03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038238 Apr 13 22:08:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 341/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:31 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-21fd135b-cdcb-4273-a608-86330de3aea6 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] Calling method '.version_select at 0x7f4b3c9c8790>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:31 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-21fd135b-cdcb-4273-a608-86330de3aea6 tempest-TestStampPattern-921591052 tempest-TestStampPattern-921591052-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-369348447" status: 202 len: 0 microversion: 2.1 time: 0.042653 Apr 13 22:08:31 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 335/1010] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 22:08:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-369348447 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1227800336", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "08fd4473-8ec0-42e1-81f9-f4799635112b"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] validate_networks() for [('08fd4473-8ec0-42e1-81f9-f4799635112b', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Getting quotas for project 7c52a86a481f425abf1cb1d75417421e. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Getting quotas for user 64bf9d3c42c14ec3b22302b6fe5d52d2 and project 7c52a86a481f425abf1cb1d75417421e. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:08:34 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:08:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-aeb296d6-4764-44cb-8fb2-ee8dfb4157fb tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.953297 Apr 13 22:08:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 335/1011] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:08:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:08:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-fc8a71fe-b326-472e-9eb1-fa518b14d558 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:35 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-fc8a71fe-b326-472e-9eb1-fa518b14d558 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:35 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-fc8a71fe-b326-472e-9eb1-fa518b14d558 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf9d3c42c14ec3b22302b6fe5d52d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52a86a481f425abf1cb1d75417421e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-fc8a71fe-b326-472e-9eb1-fa518b14d558 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec" status: 200 len: 1208 microversion: 2.1 time: 0.105479 Apr 13 22:08:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 342/1012] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:35 2023] GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:08:36 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:36 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "name": "network-vif-plugged", "status": "completed", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:36 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] Creating event network-vif-plugged:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:08:36 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-1e5b9d99-bb17-46d1-87d3-48ae98b871e1 req-9264e1d1-c431-4d84-9b2a-8b8e31410ef0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046435 Apr 13 22:08:36 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 336/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:37 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:37 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-459517e5-e2dc-4d52-87c8-ed5b4d0a0512 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1551 microversion: 2.1 time: 0.261292 Apr 13 22:08:37 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 336/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:08:37 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1551 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:08:39 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "name": "network-vif-plugged", "status": "completed", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}, {"name": "network-changed", "server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:39 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:39 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Creating event network-vif-plugged:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:08:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] Creating event network-changed:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:08:39 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-1121b2a9-89ef-41c5-b0f1-b7e6df3ae0ce req-62336312-50c3-4481-b397-c3b9f6632cf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037354 Apr 13 22:08:39 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 343/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:39 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: 6fbf2022-b069-440f-8513-6d107f0a7180] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HTTP exception thrown: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Request method failure captured: Apr 13 22:08:40 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 HTTP/1.1 Apr 13 22:08:40 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:08:40 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:08:40 user devstack@n-api.service[61665]: Connection: close Apr 13 22:08:40 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:08:40 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:08:40 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:08:40 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:08:40 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHjPowYAKsfrugQUyyaOQdyOuc8JMoC9zxSczWOZpS8iJ5jiIRNRIxqRqHtighf6ijg_yow_-4cF4lEv6hFTLyQ_1zj-S_Kplh3PIVs1J4JE9w4tiTJKd11EVqGErzn7gQswmNpXzUNV1zBoUfPbh6kDP-8HTtk68Qb5DY_Sq91HCNI Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Project-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Tenant-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-User: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:08:40 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:08:40 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:08:40 user devstack@n-api.service[61665]: X-User-Id: 0ab740920cac4befac62a72f7ce5a817 Apr 13 22:08:40 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:08:40 user devstack@n-api.service[61665]: method: > Apr 13 22:08:40 user devstack@n-api.service[61665]: exception: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. Apr 13 22:08:40 user devstack@n-api.service[61665]: action_args: {'id': '6fbf2022-b069-440f-8513-6d107f0a7180'} Apr 13 22:08:40 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. Apr 13 22:08:40 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:08:40 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Returning 404 to user: Instance 6fbf2022-b069-440f-8513-6d107f0a7180 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:08:40 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-2675a1ae-3bce-430b-b6c7-55755b1f3169 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180" status: 404 len: 111 microversion: 2.87 time: 0.034861 Apr 13 22:08:40 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 337/1016] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:08:40 2023] GET /compute/v2.1/servers/6fbf2022-b069-440f-8513-6d107f0a7180 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "name": "network-vif-plugged", "status": "completed", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] Creating event network-vif-plugged:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:08:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-5ff8ff74-e9eb-46af-bffb-babb117e0b4b req-5427847d-27dd-4ad1-ba3a-04bc72260f31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Apr 13 22:08:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 337/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:08:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-c40d9416-b448-4bfc-bd75-d6cff3746b71 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 204 len: 0 microversion: 2.87 time: 0.148118 Apr 13 22:08:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 344/1018] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 13 22:08:41 2023] DELETE /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:41 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0ab740920cac4befac62a72f7ce5a817', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11a30fba887e4114be856d26b47a8e55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:08:41 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1f317178-606b-45ca-9969-c16b5b0105d1 tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 200 len: 1697 microversion: 2.87 time: 0.220210 Apr 13 22:08:41 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 338/1019] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:08:41 2023] GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 1697 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "name": "network-vif-unplugged", "status": "completed", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] Creating event network-vif-unplugged:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 22:08:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-4d8cb20e-5c08-4315-a522-ec653a1b9e63 req-82240141-bf4d-4995-8bf1-f0634ae035c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058797 Apr 13 22:08:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 338/1020] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "name": "network-vif-plugged", "status": "completed", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}, {"server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "name": "network-vif-deleted", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Creating event network-vif-plugged:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:08:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] Creating event network-vif-deleted:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 22:08:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-8e68e9e5-6b90-4979-a18b-35863ff3f455 req-ddedc705-ba23-4e05-9d62-addffdf98a97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048124 Apr 13 22:08:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 345/1021] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:08:43 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ce77dc-eda4-4b96-8d61-2297d986f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:08:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:08:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:08:43 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:08:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] Creating event network-vif-plugged:922fdd9d-6edf-4cc1-ab31-d7255cd3c4ec for instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee on user Apr 13 22:08:43 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-25aa5cda-d259-4216-8921-4e8c002a5823 req-e9918570-31d2-4059-bbd8-ad6603da7e9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 Apr 13 22:08:43 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 339/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:08:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=26 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:14 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:15 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:09:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-47a2e4a4-fdaf-426f-a728-6049bb0caf9b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1549 microversion: 2.1 time: 0.232336 Apr 13 22:09:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 339/1023] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:09:14 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=8 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:17 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:09:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-86c9967b-2c9a-4c7c-b219-1029af0fc6b1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 200 len: 1443 microversion: 2.1 time: 0.167932 Apr 13 22:09:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 346/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:09:17 2023] GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=12 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:25 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf9d3c42c14ec3b22302b6fe5d52d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52a86a481f425abf1cb1d75417421e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:09:25 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-b6145d24-d05a-4827-92f3-629feaaf87f9 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec" status: 200 len: 1487 microversion: 2.1 time: 0.152170 Apr 13 22:09:25 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 340/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:09:25 2023] GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec => generated 1487 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] [instance: b5ce77dc-eda4-4b96-8d61-2297d986f3ee] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] HTTP exception thrown: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Request method failure captured: Apr 13 22:09:31 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee HTTP/1.1 Apr 13 22:09:31 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:09:31 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:09:31 user devstack@n-api.service[61663]: Connection: close Apr 13 22:09:31 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:09:31 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:09:31 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:09:31 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:09:31 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHjPowYAKsfrugQUyyaOQdyOuc8JMoC9zxSczWOZpS8iJ5jiIRNRIxqRqHtighf6ijg_yow_-4cF4lEv6hFTLyQ_1zj-S_Kplh3PIVs1J4JE9w4tiTJKd11EVqGErzn7gQswmNpXzUNV1zBoUfPbh6kDP-8HTtk68Qb5DY_Sq91HCNI Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Openstack-Nova-Api-Version: 2.87 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Project-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/11a30fba887e4114be856d26b47a8e55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Tenant-Id: 11a30fba887e4114be856d26b47a8e55 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-User: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:09:31 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:09:31 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:09:31 user devstack@n-api.service[61663]: X-User-Id: 0ab740920cac4befac62a72f7ce5a817 Apr 13 22:09:31 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member Apr 13 22:09:31 user devstack@n-api.service[61663]: method: > Apr 13 22:09:31 user devstack@n-api.service[61663]: exception: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. Apr 13 22:09:31 user devstack@n-api.service[61663]: action_args: {'id': 'b5ce77dc-eda4-4b96-8d61-2297d986f3ee'} Apr 13 22:09:31 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. Apr 13 22:09:31 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:09:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] Returning 404 to user: Instance b5ce77dc-eda4-4b96-8d61-2297d986f3ee could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:09:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f9ac572d-f7c0-4075-a95f-a1f76a9d399e tempest-ServerBootFromVolumeStableRescueTest-33854562 tempest-ServerBootFromVolumeStableRescueTest-33854562-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee" status: 404 len: 111 microversion: 2.87 time: 0.162156 Apr 13 22:09:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 340/1026] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 13 22:09:31 2023] GET /compute/v2.1/servers/b5ce77dc-eda4-4b96-8d61-2297d986f3ee => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:38 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] Creating event network-changed:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:09:38 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-32327f42-bb18-4d0c-ba23-4c442cb2197f req-7c99c1f8-c07c-4420-ac9d-1dff36074f69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031936 Apr 13 22:09:38 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 341/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:09:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:09:38 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:09:38 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d413d2f0-2b6b-4a38-8445-c5e0bd45c3c0 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 204 len: 0 microversion: 2.1 time: 0.116632 Apr 13 22:09:38 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 347/1028] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:09:38 2023] DELETE /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:38 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:39 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8ba9f99764b4e61ac0ed632000fc672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f16c57e44d2f456cab919015f4b9bb4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:09:39 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-44ae3b1a-731f-43af-b180-b67d7b62e227 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 200 len: 1557 microversion: 2.1 time: 0.191362 Apr 13 22:09:39 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 341/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:09:38 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:09:39 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-unplugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:09:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:39 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] Creating event network-vif-unplugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:09:39 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-22f59591-3ec3-4fc4-96b1-83bec14400ab req-27e3fe59-5759-4930-bf2e-9994cca98e7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032483 Apr 13 22:09:39 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 342/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:09:40 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-deleted", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:09:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:40 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] Creating event network-vif-deleted:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:09:40 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-9a8d076b-fc1a-4a8d-8144-641d0b26ab00 req-a425e74a-b0cd-4d3c-9f75-036112b5c066 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037855 Apr 13 22:09:40 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 348/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:09:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a70f4f57-2a18-4489-9f0d-e31e10d66fb0", "name": "network-vif-plugged", "status": "completed", "tag": "9bbf8f11-4979-445b-b429-c2b404283afc"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:09:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:09:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:09:41 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:09:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] Creating event network-vif-plugged:9bbf8f11-4979-445b-b429-c2b404283afc for instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 on user Apr 13 22:09:41 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c6948651-8023-405b-9534-da3a796c5093 req-96f65d0d-201e-4dd7-b1b1-733e9d3a007f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037472 Apr 13 22:09:41 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 342/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:15 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:10:15 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a821a38c-0ed8-41ac-8c30-f826e6bf1074 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1549 microversion: 2.1 time: 0.498539 Apr 13 22:10:15 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 343/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:15 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1549 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-f0c28a06-02d2-4dec-a39e-8a3998ad24d5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action" status: 200 len: 28387 microversion: 2.1 time: 0.225369 Apr 13 22:10:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 349/1034] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 13 22:10:15 2023] POST /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab/action => generated 28387 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:16 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:10:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8874e574-58d7-46ae-9018-b87cbb93c11b tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 200 len: 1539 microversion: 2.1 time: 0.166105 Apr 13 22:10:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 343/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:16 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:17 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:10:17 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d9ec03cd-a38f-45a1-bdd0-062020c335d1 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 200 len: 1443 microversion: 2.1 time: 0.148105 Apr 13 22:10:17 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 344/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:17 2023] GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:10:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] Creating event network-changed:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:10:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-e841ba24-6549-4e3d-bc71-213535122e50 req-4d4fadb4-3662-437b-943b-e473fb699f32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034605 Apr 13 22:10:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 350/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:10:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] Creating event network-changed:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:10:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-e665110f-34eb-4404-a405-d7be8386bb87 req-a97f1f30-f18d-4078-bf06-622d662e0a16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035303 Apr 13 22:10:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 345/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:10:19 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:10:19 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4df29fa4-d9ec-44ad-ba5c-935ce329e7d5 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 204 len: 0 microversion: 2.1 time: 0.137757 Apr 13 22:10:19 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 344/1039] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:10:19 2023] DELETE /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:19 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:10:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a3e6e533-b161-438f-8787-a516e3ee2184 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 200 len: 1568 microversion: 2.1 time: 0.176105 Apr 13 22:10:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 351/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:19 2023] GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:10:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "name": "network-vif-unplugged", "status": "completed", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] Creating event network-vif-unplugged:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:10:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-c05ad9d0-d9e8-4434-8920-03fe532e54a6 req-8f988379-4df3-4a47-bc86-744f153258c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037489 Apr 13 22:10:20 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 346/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:10:22 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "name": "network-vif-plugged", "status": "completed", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}, {"server_uuid": "459ff5ca-7911-4aa8-8cfd-e85cead816a5", "name": "network-vif-deleted", "tag": "3b01de56-e932-4de5-9e2f-ab7bc4295528"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:22 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Creating event network-vif-plugged:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:10:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] Creating event network-vif-deleted:3b01de56-e932-4de5-9e2f-ab7bc4295528 for instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 on user Apr 13 22:10:22 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-bab61b61-fe45-406d-92a1-8f45fb8b7733 req-29d8b8fc-3003-48bd-ace8-0912b3b3d33a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037565 Apr 13 22:10:22 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 345/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] [instance: a70f4f57-2a18-4489-9f0d-e31e10d66fb0] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] HTTP exception thrown: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Request method failure captured: Apr 13 22:10:29 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 HTTP/1.1 Apr 13 22:10:29 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:10:29 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:10:29 user devstack@n-api.service[61664]: Connection: close Apr 13 22:10:29 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:10:29 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:10:29 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:10:29 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:10:29 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHxEkHLG0wk8ZNQ01V3Cm1HzrAEA1h6SGcsf0lw0QI2lPRTrKK33Cshov0AYpf3BAEUFzy-PKqY_gbnjiVidjdPPQmqFnltR6zgeU_0yH0iA4iZjjsF6umEWHi64BpI-ei-96i8xR0ygmErcSBnyxR6i1XPEwxoA_39nnthrpI6ciC4 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Project-Id: f16c57e44d2f456cab919015f4b9bb4b Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestShelveInstance-1496514884 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f16c57e44d2f456cab919015f4b9bb4b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f16c57e44d2f456cab919015f4b9bb4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f16c57e44d2f456cab919015f4b9bb4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Tenant: tempest-TestShelveInstance-1496514884 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Tenant-Id: f16c57e44d2f456cab919015f4b9bb4b Apr 13 22:10:29 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestShelveInstance-1496514884 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-User: tempest-TestShelveInstance-1496514884-project-member Apr 13 22:10:29 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:10:29 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:10:29 user devstack@n-api.service[61664]: X-User-Id: c8ba9f99764b4e61ac0ed632000fc672 Apr 13 22:10:29 user devstack@n-api.service[61664]: X-User-Name: tempest-TestShelveInstance-1496514884-project-member Apr 13 22:10:29 user devstack@n-api.service[61664]: method: > Apr 13 22:10:29 user devstack@n-api.service[61664]: exception: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. Apr 13 22:10:29 user devstack@n-api.service[61664]: action_args: {'id': 'a70f4f57-2a18-4489-9f0d-e31e10d66fb0'} Apr 13 22:10:29 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. Apr 13 22:10:29 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:10:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Returning 404 to user: Instance a70f4f57-2a18-4489-9f0d-e31e10d66fb0 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:10:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-dc734155-490b-43c6-9573-d74a6bb555e4 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0" status: 404 len: 111 microversion: 2.1 time: 0.035709 Apr 13 22:10:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 352/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:29 2023] GET /compute/v2.1/servers/a70f4f57-2a18-4489-9f0d-e31e10d66fb0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:10:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a90d87e0-d2fe-4838-8152-89c1f21b3112 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] Calling method '.version_select at 0x7f4b3c965f30>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a90d87e0-d2fe-4838-8152-89c1f21b3112 tempest-TestShelveInstance-1496514884 tempest-TestShelveInstance-1496514884-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-299000327" status: 202 len: 0 microversion: 2.1 time: 0.026292 Apr 13 22:10:29 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 347/1044] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 13 22:10:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-299000327 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:10:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-916cdcbc-d006-42a4-92af-85132a4dfa6b tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec" status: 204 len: 0 microversion: 2.1 time: 0.197231 Apr 13 22:10:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 346/1045] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:10:32 2023] DELETE /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:33 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=16 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:10:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "name": "network-vif-unplugged", "status": "completed", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] Creating event network-vif-unplugged:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:10:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-0488b424-fe68-449a-854a-864e97833021 req-35637d13-294e-457e-acef-57398ba1cb29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045127 Apr 13 22:10:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 348/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:10:33 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64bf9d3c42c14ec3b22302b6fe5d52d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c52a86a481f425abf1cb1d75417421e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:10:33 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-d5e078c7-5dec-4c17-9eff-eb2da0cba616 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec" status: 200 len: 1493 microversion: 2.1 time: 0.414856 Apr 13 22:10:33 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 353/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:10:32 2023] GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec => generated 1493 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:10:35 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "name": "network-vif-plugged", "status": "completed", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}, {"server_uuid": "9b94df42-303b-484a-a778-4089323072ec", "name": "network-vif-deleted", "tag": "6e8199a3-60b0-4e19-9106-76cc2118a167"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:10:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:10:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:10:35 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:10:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Creating event network-vif-plugged:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:10:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] Creating event network-vif-deleted:6e8199a3-60b0-4e19-9106-76cc2118a167 for instance 9b94df42-303b-484a-a778-4089323072ec on user Apr 13 22:10:35 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-c5e564c7-c362-4093-a4f5-b93b60683141 req-f97cc063-4586-4db1-89fb-97c3e98cd011 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031739 Apr 13 22:10:35 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 347/1048] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:10:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:11:09 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:09 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 459ff5ca-7911-4aa8-8cfd-e85cead816a5] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:11:10 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 HTTP/1.1 Apr 13 22:11:10 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:11:10 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:11:10 user devstack@n-api.service[61665]: Connection: close Apr 13 22:11:10 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:11:10 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:11:10 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:11:10 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:11:10 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:11:10 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:11:10 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:11:10 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:11:10 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:11:10 user devstack@n-api.service[61665]: method: > Apr 13 22:11:10 user devstack@n-api.service[61665]: exception: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. Apr 13 22:11:10 user devstack@n-api.service[61665]: action_args: {'id': '459ff5ca-7911-4aa8-8cfd-e85cead816a5'} Apr 13 22:11:10 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. Apr 13 22:11:10 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 459ff5ca-7911-4aa8-8cfd-e85cead816a5 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:11:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a08bc1e7-740b-4485-8261-323247317392 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5" status: 404 len: 111 microversion: 2.1 time: 0.250332 Apr 13 22:11:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 349/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:11:09 2023] GET /compute/v2.1/servers/459ff5ca-7911-4aa8-8cfd-e85cead816a5 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=10 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=20 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:11:15 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:11:15 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-eaf5da36-d5dc-457e-aa63-924b6abcae44 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 204 len: 0 microversion: 2.1 time: 0.134764 Apr 13 22:11:15 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 354/1050] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:11:15 2023] DELETE /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:15 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:15 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] Creating event network-changed:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:11:15 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-745f48a4-8d38-433a-987e-53c9c2cfd9b3 req-af4e03d3-4098-40e7-93ef-10213d44e8aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163258 Apr 13 22:11:15 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 348/1051] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a8a5f433c94e0c9ba4d6ecea37d756', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad824150d99044c6ab1c7829cbe01de5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:11:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8fac0cd1-6d5d-4599-8426-5698e2e703ee tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 200 len: 1566 microversion: 2.1 time: 0.413173 Apr 13 22:11:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 350/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:11:15 2023] GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 1566 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:11:16 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "name": "network-vif-unplugged", "status": "completed", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:11:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:16 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] Creating event network-vif-unplugged:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:11:16 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-2bb68f68-cbaa-4464-99f8-adafb8870b0a req-a161e313-e763-43d1-ba24-21be263de21b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088721 Apr 13 22:11:16 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 355/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:16 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:11:16 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6566a50d-d64e-4518-92af-4522da5310e5 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 204 len: 0 microversion: 2.1 time: 0.148989 Apr 13 22:11:16 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 349/1054] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:11:16 2023] DELETE /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:16 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:11:16 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d857fb27-34e9-4373-8b55-37597cf81297 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 200 len: 1555 microversion: 2.1 time: 0.204533 Apr 13 22:11:16 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 351/1055] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:11:16 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:11:18 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "name": "network-vif-plugged", "status": "completed", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}, {"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-unplugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}, {"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-plugged", "status": "completed", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}, {"server_uuid": "7741644e-2273-4d75-9b4d-8bf386400b07", "name": "network-vif-deleted", "tag": "7cc730c3-a97b-4fd0-8e8e-25e07a307843"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:11:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:18 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Creating event network-vif-plugged:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:11:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Creating event network-vif-unplugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:11:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Creating event network-vif-plugged:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:11:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] Creating event network-vif-deleted:7cc730c3-a97b-4fd0-8e8e-25e07a307843 for instance 7741644e-2273-4d75-9b4d-8bf386400b07 on user Apr 13 22:11:18 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-d7316898-4590-47c7-b93c-f11dcd400fb1 req-6432293f-ef20-477c-829b-6c5337b9973d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.035675 Apr 13 22:11:18 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 356/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:11:20 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03027926-4eef-4af8-afca-b70f625de6ab", "name": "network-vif-deleted", "tag": "c519a061-16fb-426a-ba45-ff2fa6d655cd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:11:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:20 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] Creating event network-vif-deleted:c519a061-16fb-426a-ba45-ff2fa6d655cd for instance 03027926-4eef-4af8-afca-b70f625de6ab on user Apr 13 22:11:20 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-d4eb2f3d-166e-4f2c-aef8-a008d427adc2 req-ed74b790-42b6-4984-b58f-cd2019789f3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032946 Apr 13 22:11:20 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 350/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] [instance: 9b94df42-303b-484a-a778-4089323072ec] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:11:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] HTTP exception thrown: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Request method failure captured: Apr 13 22:11:23 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec HTTP/1.1 Apr 13 22:11:23 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:11:23 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:11:23 user devstack@n-api.service[61665]: Connection: close Apr 13 22:11:23 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:11:23 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:11:23 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:11:23 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:11:23 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOH1gU39dMuEOXmd-M1gmoGr70nOODEoT0EBc157OvjRE6pC1CP931vZFlcVyXZhrlFQJTCKB26rivvrROGPpTs83eRoCyqTClOCRdmGJ75_OLmMiuEbU7005Vn6dN0l0LQcxUyc5jhnwHGoTTSjseRl_WqChUqG7Bfswd9qiGbxkkbw Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Project-Id: 7c52a86a481f425abf1cb1d75417421e Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Project-Name: tempest-VolumesActionsTest-635015448 Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c52a86a481f425abf1cb1d75417421e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c52a86a481f425abf1cb1d75417421e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c52a86a481f425abf1cb1d75417421e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Tenant: tempest-VolumesActionsTest-635015448 Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Tenant-Id: 7c52a86a481f425abf1cb1d75417421e Apr 13 22:11:23 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-VolumesActionsTest-635015448 Apr 13 22:11:23 user devstack@n-api.service[61665]: X-User: tempest-VolumesActionsTest-635015448-project-member Apr 13 22:11:23 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:11:23 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:11:23 user devstack@n-api.service[61665]: X-User-Id: 64bf9d3c42c14ec3b22302b6fe5d52d2 Apr 13 22:11:23 user devstack@n-api.service[61665]: X-User-Name: tempest-VolumesActionsTest-635015448-project-member Apr 13 22:11:23 user devstack@n-api.service[61665]: method: > Apr 13 22:11:23 user devstack@n-api.service[61665]: exception: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. Apr 13 22:11:23 user devstack@n-api.service[61665]: action_args: {'id': '9b94df42-303b-484a-a778-4089323072ec'} Apr 13 22:11:23 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. Apr 13 22:11:23 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:11:23 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] Returning 404 to user: Instance 9b94df42-303b-484a-a778-4089323072ec could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:11:23 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-577aad07-7f89-4edc-b89b-03a97423a9f4 tempest-VolumesActionsTest-635015448 tempest-VolumesActionsTest-635015448-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec" status: 404 len: 111 microversion: 2.1 time: 0.029099 Apr 13 22:11:23 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 352/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:11:23 2023] GET /compute/v2.1/servers/9b94df42-303b-484a-a778-4089323072ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-35cef8ed-eb80-4235-8c9a-82ecc7455e2f tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad5480>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-309329044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9XkDpXhLx2lD4nmCeUpGxMpC/VFcXLSvCzntgsNgb64krEwq5BWwDBJWc1x5yyVX69xPhJUs3X6CciUn9Km/V9mjQ049ygcxsePVnYfHZd+dk8rzLWXHe57ZxDlzgQ6g=="}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:01 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-35cef8ed-eb80-4235-8c9a-82ecc7455e2f tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting quotas for project 6d6949ee0fd24ee7a17424681e101afb. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:12:01 user devstack@n-api.service[61664]: DEBUG nova.quota [None req-35cef8ed-eb80-4235-8c9a-82ecc7455e2f tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting quotas for user 94829076c7fa4750a1612b018b83b996 and project 6d6949ee0fd24ee7a17424681e101afb. Resources: {'key_pairs'} {{(pid=61664) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:12:02 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-35cef8ed-eb80-4235-8c9a-82ecc7455e2f tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.301038 Apr 13 22:12:02 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 357/1059] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 13 22:12:01 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1406592688", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-309329044", "security_groups": [{"name": "tempest-secgroup-smoke-704236853"}], "networks": [{"uuid": "aac8aaa5-9c86-480a-99cf-6f9f3beb2264"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] validate_networks() for [('aac8aaa5-9c86-480a-99cf-6f9f3beb2264', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting quotas for project 6d6949ee0fd24ee7a17424681e101afb. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Getting quotas for user 94829076c7fa4750a1612b018b83b996 and project 6d6949ee0fd24ee7a17424681e101afb. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:12:03 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:12:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0fcb4c7d-8f65-41a9-8133-a0ae60bfbd21 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.832104 Apr 13 22:12:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 351/1060] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:12:03 2023] POST /compute/v2.1/servers => generated 403 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:12:04 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-707fbd7e-624f-4bcb-8e50-11a1024bcf73 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:04 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-707fbd7e-624f-4bcb-8e50-11a1024bcf73 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:04 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=8 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:04 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=16 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:04 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-707fbd7e-624f-4bcb-8e50-11a1024bcf73 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94829076c7fa4750a1612b018b83b996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6949ee0fd24ee7a17424681e101afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:12:04 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-707fbd7e-624f-4bcb-8e50-11a1024bcf73 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 200 len: 1256 microversion: 2.1 time: 0.071179 Apr 13 22:12:04 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 353/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:04 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 1256 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: 7741644e-2273-4d75-9b4d-8bf386400b07] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61664]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61664]: method: > Apr 13 22:12:06 user devstack@n-api.service[61664]: exception: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: action_args: {'id': '7741644e-2273-4d75-9b4d-8bf386400b07'} Apr 13 22:12:06 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance 7741644e-2273-4d75-9b4d-8bf386400b07 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-28f18e0f-287b-4835-b9b5-00a9d6aaf706 tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07" status: 404 len: 111 microversion: 2.1 time: 0.064071 Apr 13 22:12:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 358/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:06 2023] GET /compute/v2.1/servers/7741644e-2273-4d75-9b4d-8bf386400b07 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61663]: request: DELETE /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61663]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61663]: method: > Apr 13 22:12:06 user devstack@n-api.service[61663]: exception: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: action_args: {'id': 'fc6cc27b-3d35-44e3-97dd-aac5a596d21c'} Apr 13 22:12:06 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-27dd9eb0-9274-4d3f-9825-7a71c95610cd tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 404 len: 111 microversion: 2.1 time: 0.051829 Apr 13 22:12:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 352/1063] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:12:06 2023] DELETE /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] [instance: fc6cc27b-3d35-44e3-97dd-aac5a596d21c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] HTTP exception thrown: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61665]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHo0z9XkWQSk_bgcOEV7jE3rL0sCLuDMPAC4i96A-qP__mxdtQ66P3MQxIOSt_jjggfnIv5fbtZw67_FQuKVSICssosOFjuhFBLWJb3WY3hDevS1OGh6ZNxB4K_QaVSr6Ieaw36vyiedXG5RatLZBhWXe3KqkD3ytB702kYlQHdTth8 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ad824150d99044c6ab1c7829cbe01de5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant-Id: ad824150d99044c6ab1c7829cbe01de5 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335483698 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Id: 50a8a5f433c94e0c9ba4d6ecea37d756 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Name: tempest-TestVolumeBootPattern-1335483698-project-member Apr 13 22:12:06 user devstack@n-api.service[61665]: method: > Apr 13 22:12:06 user devstack@n-api.service[61665]: exception: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: action_args: {'id': 'fc6cc27b-3d35-44e3-97dd-aac5a596d21c'} Apr 13 22:12:06 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Returning 404 to user: Instance fc6cc27b-3d35-44e3-97dd-aac5a596d21c could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ac9c8c75-f162-46f5-9c0e-43cba42176ea tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c" status: 404 len: 111 microversion: 2.1 time: 0.031115 Apr 13 22:12:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:06 2023] GET /compute/v2.1/servers/fc6cc27b-3d35-44e3-97dd-aac5a596d21c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] Creating event network-changed:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-dfceaae6-a2da-4673-bd46-24e37b37d004 req-bd4c96af-8599-483f-af48-c23ed5a637a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035515 Apr 13 22:12:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 353/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61664]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:12:06 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61664]: method: > Apr 13 22:12:06 user devstack@n-api.service[61664]: exception: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: action_args: {'id': '03027926-4eef-4af8-afca-b70f625de6ab'} Apr 13 22:12:06 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b1bce628-ba44-4a43-8fde-9397803be248 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 404 len: 111 microversion: 2.1 time: 0.046783 Apr 13 22:12:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 359/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:06 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61665]: request: DELETE /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61665]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:12:06 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61665]: method: > Apr 13 22:12:06 user devstack@n-api.service[61665]: exception: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: action_args: {'id': '03027926-4eef-4af8-afca-b70f625de6ab'} Apr 13 22:12:06 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-14ee382a-eaff-4e2f-8094-fa086c2f29ad tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 404 len: 111 microversion: 2.1 time: 0.032422 Apr 13 22:12:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 355/1067] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:12:06 2023] DELETE /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: 03027926-4eef-4af8-afca-b70f625de6ab] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:12:06 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab HTTP/1.1 Apr 13 22:12:06 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:12:06 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:12:06 user devstack@n-api.service[61663]: Connection: close Apr 13 22:12:06 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:12:06 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:12:06 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:12:06 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:12:06 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:12:06 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:06 user devstack@n-api.service[61663]: method: > Apr 13 22:12:06 user devstack@n-api.service[61663]: exception: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: action_args: {'id': '03027926-4eef-4af8-afca-b70f625de6ab'} Apr 13 22:12:06 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. Apr 13 22:12:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:12:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance 03027926-4eef-4af8-afca-b70f625de6ab could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-153b3bdb-c8c7-41f0-a808-4290eb3e4416 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab" status: 404 len: 111 microversion: 2.1 time: 0.031970 Apr 13 22:12:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 354/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:06 2023] GET /compute/v2.1/servers/03027926-4eef-4af8-afca-b70f625de6ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:06 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Going to try to terminate instance {{(pid=61664) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:12:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-4acf6de0-2d90-45ac-abea-54694798d99d tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 204 len: 0 microversion: 2.1 time: 0.144814 Apr 13 22:12:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 360/1069] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:12:06 2023] DELETE /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:06 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "name": "network-vif-unplugged", "status": "completed", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:07 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] Creating event network-vif-unplugged:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:12:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-29399d31-270b-40ac-9a10-1b8709f28954 req-05bdd983-149f-41ba-ad88-26a1822c7f56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033653 Apr 13 22:12:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 355/1070] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:07 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3db8b01a05b43f68bfd8695253514db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c086cffbafb4da68f172ab27da232d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:12:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-ff411881-1f10-47cf-b6e3-cc57b7567af2 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 200 len: 1545 microversion: 2.1 time: 0.406241 Apr 13 22:12:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 356/1071] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:06 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 1545 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:12:08 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "name": "network-vif-deleted", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:08 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] Creating event network-vif-deleted:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:12:08 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-18aa371c-3a1e-40a5-a41b-3e9ca92051ec req-d94737f8-9821-402a-8dc0-cdda778f4cf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047930 Apr 13 22:12:08 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 361/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:09 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-1a5cdf3b-067e-43f6-9de9-562acaf5519f tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] Calling method '.version_select at 0x7f4b3cec27a0>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:09 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-1a5cdf3b-067e-43f6-9de9-562acaf5519f tempest-TestVolumeBootPattern-1335483698 tempest-TestVolumeBootPattern-1335483698-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-949568181" status: 202 len: 0 microversion: 2.1 time: 0.023819 Apr 13 22:12:09 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 356/1073] 10.0.0.210 () {62 vars in 1337 bytes} [Thu Apr 13 22:12:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-949568181 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:12:09 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada4ed22-c00b-47cd-885b-58d7eceff652", "name": "network-vif-plugged", "status": "completed", "tag": "832e1c7c-c4ab-4265-8173-6aa27ed74a1e"}, {"server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "name": "network-vif-plugged", "status": "completed", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:09 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Creating event network-vif-plugged:832e1c7c-c4ab-4265-8173-6aa27ed74a1e for instance ada4ed22-c00b-47cd-885b-58d7eceff652 on user Apr 13 22:12:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] Creating event network-vif-plugged:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:12:09 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-e4ce1d95-0ffa-4145-ae4c-ee755164f841 req-b63c2770-0f28-4aec-a44d-3baf2c9dd17b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047325 Apr 13 22:12:09 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 357/1074] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:12:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:11 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "name": "network-vif-plugged", "status": "completed", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:12:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:11 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] Creating event network-vif-plugged:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:12:11 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-f9ac2b82-aeda-4b52-b157-e08d367981c7 req-ad243067-a607-4e07-8e07-ccbf0e8078a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Apr 13 22:12:11 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 362/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=10 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94829076c7fa4750a1612b018b83b996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6949ee0fd24ee7a17424681e101afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:12:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-72699a62-97e0-4da7-a155-087926efc4b6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 200 len: 1567 microversion: 2.1 time: 0.178912 Apr 13 22:12:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 357/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:54 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=12 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=12 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: ada4ed22-c00b-47cd-885b-58d7eceff652] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:12:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:12:57 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 HTTP/1.1 Apr 13 22:12:57 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:12:57 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:12:57 user devstack@n-api.service[61665]: Connection: close Apr 13 22:12:57 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:12:57 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:12:57 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:12:57 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:12:57 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:12:57 user devstack@n-api.service[61665]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:57 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:12:57 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:12:57 user devstack@n-api.service[61665]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:12:57 user devstack@n-api.service[61665]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:12:57 user devstack@n-api.service[61665]: method: > Apr 13 22:12:57 user devstack@n-api.service[61665]: exception: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. Apr 13 22:12:57 user devstack@n-api.service[61665]: action_args: {'id': 'ada4ed22-c00b-47cd-885b-58d7eceff652'} Apr 13 22:12:57 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. Apr 13 22:12:57 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:12:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance ada4ed22-c00b-47cd-885b-58d7eceff652 could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:12:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-a72c68da-9af1-46e8-910b-5dbfeef2560a tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652" status: 404 len: 111 microversion: 2.1 time: 0.043454 Apr 13 22:12:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:12:57 2023] GET /compute/v2.1/servers/ada4ed22-c00b-47cd-885b-58d7eceff652 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:13:01 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 HTTP/1.1 Apr 13 22:13:01 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:13:01 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:13:01 user devstack@n-api.service[61664]: Connection: close Apr 13 22:13:01 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:13:01 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:13:01 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:13:01 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:13:01 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61664]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:13:01 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:13:01 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:13:01 user devstack@n-api.service[61664]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:13:01 user devstack@n-api.service[61664]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:13:01 user devstack@n-api.service[61664]: method: > Apr 13 22:13:01 user devstack@n-api.service[61664]: exception: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61664]: action_args: {'id': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'} Apr 13 22:13:01 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:01 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-b59e04b0-1472-40d9-8044-912587265352 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 404 len: 111 microversion: 2.1 time: 0.049599 Apr 13 22:13:01 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 363/1078] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:13:01 2023] DELETE /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] [instance: c895d9cf-e6c1-42d6-88e3-1209b203fbe3] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] HTTP exception thrown: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Request method failure captured: Apr 13 22:13:01 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 HTTP/1.1 Apr 13 22:13:01 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:13:01 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:13:01 user devstack@n-api.service[61663]: Connection: close Apr 13 22:13:01 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:13:01 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:13:01 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:13:01 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:13:01 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOHinc2WWcQ1nq8fQJvhHvd3pqx8FNzwmHFAqA_nv6LJi1MO_rGcN3WRcxiLaQpI3mFzmUu5fgu4DROWTfZc8GicO_Zxz6Vh3ju4OnKMZ6f40hHJFUPzoFhWao0AFfG2yvdS9qTe76Dbg7OvpXvo_InA9ymL-9RqcH6sQRlTQQAycIdY Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Project-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Project-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c086cffbafb4da68f172ab27da232d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Tenant: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Tenant-Id: 7c086cffbafb4da68f172ab27da232d3 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-ServerActionsTestJSON-236976022 Apr 13 22:13:01 user devstack@n-api.service[61663]: X-User: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:13:01 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:13:01 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:13:01 user devstack@n-api.service[61663]: X-User-Id: b3db8b01a05b43f68bfd8695253514db Apr 13 22:13:01 user devstack@n-api.service[61663]: X-User-Name: tempest-ServerActionsTestJSON-236976022-project-member Apr 13 22:13:01 user devstack@n-api.service[61663]: method: > Apr 13 22:13:01 user devstack@n-api.service[61663]: exception: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61663]: action_args: {'id': 'c895d9cf-e6c1-42d6-88e3-1209b203fbe3'} Apr 13 22:13:01 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. Apr 13 22:13:01 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:01 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Returning 404 to user: Instance c895d9cf-e6c1-42d6-88e3-1209b203fbe3 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:01 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-05de4963-f036-4d95-9f9c-307a42f75eae tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3" status: 404 len: 111 microversion: 2.1 time: 0.036283 Apr 13 22:13:01 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 358/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:13:01 2023] GET /compute/v2.1/servers/c895d9cf-e6c1-42d6-88e3-1209b203fbe3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:13:01 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-2071f188-ed9f-46f8-89aa-86299af6ea24 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] Calling method '.version_select at 0x7f4b3c9cb520>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:01 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-2071f188-ed9f-46f8-89aa-86299af6ea24 tempest-ServerActionsTestJSON-236976022 tempest-ServerActionsTestJSON-236976022-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140865131" status: 202 len: 0 microversion: 2.1 time: 0.025730 Apr 13 22:13:01 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 359/1080] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 13 22:13:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140865131 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:13:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e7f26952-b957-4bdc-ac6b-849753f9df98 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cad5f30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2062289207", "metadata": {"Type": "work"}}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e7f26952-b957-4bdc-ac6b-849753f9df98 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:06 user devstack@n-api.service[61664]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:13:06 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:13:06 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:13:06 user devstack@n-api.service[61664]: Connection: close Apr 13 22:13:06 user devstack@n-api.service[61664]: Content-Length: 122 Apr 13 22:13:06 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:13:06 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:13:06 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:13:06 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61664]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61664]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:06 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61664]: Apr 13 22:13:06 user devstack@n-api.service[61664]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2062289207", "metadata": {"Type": "work"}}} Apr 13 22:13:06 user devstack@n-api.service[61664]: method: Apr 13 22:13:06 user devstack@n-api.service[61664]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61664]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2062289207', 'metadata': {'Type': 'work'}}}} Apr 13 22:13:06 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi '#$%' Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-e7f26952-b957-4bdc-ac6b-849753f9df98 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:06 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-e7f26952-b957-4bdc-ac6b-849753f9df98 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181077 Apr 13 22:13:06 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 364/1081] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:13:06 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:13:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8b0767e9-4e4a-4824-9251-414fab65d7e2 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Action: 'create', calling method: .version_select at 0x7f4b3cec3640>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-315356712", "metadata": {"Type": "work"}}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8b0767e9-4e4a-4824-9251-414fab65d7e2 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:06 user devstack@n-api.service[61663]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:13:06 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:13:06 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:13:06 user devstack@n-api.service[61663]: Connection: close Apr 13 22:13:06 user devstack@n-api.service[61663]: Content-Length: 119 Apr 13 22:13:06 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:13:06 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:13:06 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:13:06 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61663]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61663]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:06 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61663]: Apr 13 22:13:06 user devstack@n-api.service[61663]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-315356712", "metadata": {"Type": "work"}}} Apr 13 22:13:06 user devstack@n-api.service[61663]: method: Apr 13 22:13:06 user devstack@n-api.service[61663]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:13:06 user devstack@n-api.service[61663]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-315356712', 'metadata': {'Type': 'work'}}}} Apr 13 22:13:06 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi '0' Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 13 22:13:06 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-8b0767e9-4e4a-4824-9251-414fab65d7e2 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:06 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-8b0767e9-4e4a-4824-9251-414fab65d7e2 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011372 Apr 13 22:13:06 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 359/1082] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:13:06 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:13:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-0f6c7499-709a-4999-bfb1-2a7ec021ead4 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Action: 'create', calling method: .version_select at 0x7f4b3ca4e3b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-910126818", "metadata": {"Type": "work"}}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-0f6c7499-709a-4999-bfb1-2a7ec021ead4 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:06 user devstack@n-api.service[61665]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 13 22:13:06 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:13:06 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:13:06 user devstack@n-api.service[61665]: Connection: close Apr 13 22:13:06 user devstack@n-api.service[61665]: Content-Length: 118 Apr 13 22:13:06 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:13:06 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:13:06 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:13:06 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:06 user devstack@n-api.service[61665]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:13:06 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:13:06 user devstack@n-api.service[61665]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:06 user devstack@n-api.service[61665]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:06 user devstack@n-api.service[61665]: Apr 13 22:13:06 user devstack@n-api.service[61665]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-910126818", "metadata": {"Type": "work"}}} Apr 13 22:13:06 user devstack@n-api.service[61665]: method: Apr 13 22:13:06 user devstack@n-api.service[61665]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61665]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-910126818', 'metadata': {'Type': 'work'}}}} Apr 13 22:13:06 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise error Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi '' Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 13 22:13:06 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:13:06 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-0f6c7499-709a-4999-bfb1-2a7ec021ead4 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:06 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-0f6c7499-709a-4999-bfb1-2a7ec021ead4 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015448 Apr 13 22:13:06 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 360/1083] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 13 22:13:06 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 13 22:13:06 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2b0d8016-0796-439a-b812-f2ec29ab5ab6 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Calling method '.version_select at 0x7f4b3c7a2830>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-2b0d8016-0796-439a-b812-f2ec29ab5ab6 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] HTTP exception thrown: Volume tempest-invalid-2061356219 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2b0d8016-0796-439a-b812-f2ec29ab5ab6 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:07 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2061356219 HTTP/1.1 Apr 13 22:13:07 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:13:07 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:13:07 user devstack@n-api.service[61664]: Connection: close Apr 13 22:13:07 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:13:07 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:13:07 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:13:07 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:13:07 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61664]: method: Apr 13 22:13:07 user devstack@n-api.service[61664]: exception: Volume tempest-invalid-2061356219 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: action_args: {'id': 'tempest-invalid-2061356219'} Apr 13 22:13:07 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2061356219 could not be found. (HTTP 404) (Request-ID: req-3e018563-29e0-40e6-8bbf-73d25adece7a) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2061356219 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2061356219 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2061356219 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2b0d8016-0796-439a-b812-f2ec29ab5ab6 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 404 to user: Volume tempest-invalid-2061356219 could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2b0d8016-0796-439a-b812-f2ec29ab5ab6 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2061356219" status: 404 len: 99 microversion: 2.1 time: 0.198694 Apr 13 22:13:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 365/1084] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 13 22:13:06 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-2061356219 => generated 99 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 13 22:13:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5913eeba-6f2e-4d81-9588-0cf6717ebc6d tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003869 Apr 13 22:13:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 360/1085] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 13 22:13:07 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 22:13:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-931f7a85-7376-4a41-bf1b-6f24876048ac tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003963 Apr 13 22:13:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 361/1086] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 13 22:13:07 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 13 22:13:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ec4a8fb-552c-4088-a71b-9475190a5eb7 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Calling method '.version_select at 0x7f4b3ccc3d90>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-0ec4a8fb-552c-4088-a71b-9475190a5eb7 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] HTTP exception thrown: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ec4a8fb-552c-4088-a71b-9475190a5eb7 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:07 user devstack@n-api.service[61664]: request: DELETE /compute/v2.1/os-volumes/d5d3be11-08f3-4ccf-90cb-9e85a3f4361d HTTP/1.1 Apr 13 22:13:07 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:13:07 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:13:07 user devstack@n-api.service[61664]: Connection: close Apr 13 22:13:07 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:13:07 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:13:07 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:13:07 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:13:07 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:07 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61664]: method: Apr 13 22:13:07 user devstack@n-api.service[61664]: exception: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: action_args: {'id': 'd5d3be11-08f3-4ccf-90cb-9e85a3f4361d'} Apr 13 22:13:07 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. (HTTP 404) (Request-ID: req-ff6e2874-c90b-49d6-8fd6-2077b2ed9f8e) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. Apr 13 22:13:07 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-0ec4a8fb-552c-4088-a71b-9475190a5eb7 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 404 to user: Volume d5d3be11-08f3-4ccf-90cb-9e85a3f4361d could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:07 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-0ec4a8fb-552c-4088-a71b-9475190a5eb7 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d5d3be11-08f3-4ccf-90cb-9e85a3f4361d" status: 404 len: 109 microversion: 2.1 time: 0.035640 Apr 13 22:13:07 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 366/1087] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 13 22:13:07 2023] DELETE /compute/v2.1/os-volumes/d5d3be11-08f3-4ccf-90cb-9e85a3f4361d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-13899c2c-798e-4543-a0ed-09dbe38388b3 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Calling method '.version_select at 0x7f4b3cce2320>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-13899c2c-798e-4543-a0ed-09dbe38388b3 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] HTTP exception thrown: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-13899c2c-798e-4543-a0ed-09dbe38388b3 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Request method failure captured: Apr 13 22:13:07 user devstack@n-api.service[61663]: request: GET /compute/v2.1/os-volumes/4a06db34-9626-4ddc-bfdf-6378d6095070 HTTP/1.1 Apr 13 22:13:07 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:13:07 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:13:07 user devstack@n-api.service[61663]: Connection: close Apr 13 22:13:07 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:13:07 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:13:07 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:13:07 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:13:07 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOH5y6PNRokuZK04Emf2m73YDBH42uxLjj_WSryMGAx0mQKzraZ3GN3V_YVPXXIj_5kmTh_FLV-gOVCb28Nkwvp9kD4H6lFQ5vKKuDv-YQ0lFFyFdX-gJPjJ2SX8BnNXovwkkLLSbLsgGvaQVUkazC_WKuXAUJfFu_euUuW4PP31wUaA Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Project-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/529c3954b7a64c0aa4c1168379e3a3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Tenant-Id: 529c3954b7a64c0aa4c1168379e3a3e3 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesNegativeTest-965066008 Apr 13 22:13:07 user devstack@n-api.service[61663]: X-User: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:13:07 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:13:07 user devstack@n-api.service[61663]: X-User-Id: 7d400bbd8c024244be26fff084275fdf Apr 13 22:13:07 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesNegativeTest-965066008-project-member Apr 13 22:13:07 user devstack@n-api.service[61663]: method: Apr 13 22:13:07 user devstack@n-api.service[61663]: exception: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61663]: action_args: {'id': '4a06db34-9626-4ddc-bfdf-6378d6095070'} Apr 13 22:13:07 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. (HTTP 404) (Request-ID: req-68e49dc0-2a9f-47e0-a65e-9fa1e266d72d) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. Apr 13 22:13:07 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:13:07 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-13899c2c-798e-4543-a0ed-09dbe38388b3 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] Returning 404 to user: Volume 4a06db34-9626-4ddc-bfdf-6378d6095070 could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:13:07 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-13899c2c-798e-4543-a0ed-09dbe38388b3 tempest-VolumesNegativeTest-965066008 tempest-VolumesNegativeTest-965066008-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4a06db34-9626-4ddc-bfdf-6378d6095070" status: 404 len: 109 microversion: 2.1 time: 0.054132 Apr 13 22:13:07 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 361/1088] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 13 22:13:07 2023] GET /compute/v2.1/os-volumes/4a06db34-9626-4ddc-bfdf-6378d6095070 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:13:28 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:28 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:28 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1880396292", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "1a54a91f-df14-4f72-a7da-7925d7095861"}]}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:28 user devstack@n-api.service[61665]: DEBUG nova.network.neutron [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] validate_networks() for [('1a54a91f-df14-4f72-a7da-7925d7095861', None, None, None, None, None)] {{(pid=61665) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image limits 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image pref 0:0:0 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.virt.hardware [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61665) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting quotas for project ce27f9e91bca45b897b419eac137138c. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.quota [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting quotas for user cca0b25a70ee4f8e986db91bb9a54662 and project ce27f9e91bca45b897b419eac137138c. Resources: {'instances', 'cores', 'ram'} {{(pid=61665) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Going to run 1 instances... {{(pid=61665) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:13:29 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61665) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:13:29 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-1656e73d-246d-4d19-92f3-5d02ecd1136e tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.577942 Apr 13 22:13:29 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 362/1089] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:13:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:13:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:29 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:29 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-6d48dee0-5935-4484-837c-59538977ce21 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:29 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-6d48dee0-5935-4484-837c-59538977ce21 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:13:29 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-6d48dee0-5935-4484-837c-59538977ce21 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:13:29 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-6d48dee0-5935-4484-837c-59538977ce21 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce" status: 200 len: 1213 microversion: 2.1 time: 0.077479 Apr 13 22:13:29 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 367/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:13:29 2023] GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=8 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:31 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] Creating event network-changed:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:13:31 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-88729b62-725d-4a8b-bc11-1104fb71ca7b req-00edbf35-7ac6-4d44-aac9-f5184eca1f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105476 Apr 13 22:13:31 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 362/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:13:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:13:33 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "name": "network-vif-plugged", "status": "completed", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:33 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] Creating event network-vif-plugged:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:13:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-d26ae3d4-0e00-4e8a-b853-be8cbaa1b107 req-c60feb3f-8545-4a61-881b-4d4b206d2228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Apr 13 22:13:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 363/1092] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:13:35 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "name": "network-vif-plugged", "status": "completed", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:35 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] Creating event network-vif-plugged:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:13:35 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-abad51f0-d0c4-4e35-8a25-6f0eb15eec09 req-1fe896e5-cd48-440a-a76b-da7a1d96b648 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029380 Apr 13 22:13:35 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 368/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:54 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94829076c7fa4750a1612b018b83b996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6949ee0fd24ee7a17424681e101afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:13:54 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-be29e8fb-c5bb-46de-9383-07f12a0ab88c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 200 len: 1567 microversion: 2.1 time: 0.182322 Apr 13 22:13:54 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 363/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:13:54 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:57 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell0:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] Creating event network-changed:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e4527be-c284-43a8-9aba-abd5cad4153b"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:13:57 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-79cf3863-d631-440b-ac07-d317e4793232 req-32b9ef99-90ec-4383-8af4-cc02853b569e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109065 Apr 13 22:13:57 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 364/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:13:57 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:13:58 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-3c3206fe-8882-453e-9bee-5218040b2906 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328370 Apr 13 22:13:58 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 369/1096] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:13:57 2023] POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:13 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:14 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'services' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:14:14 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-5b97b3c7-f9b7-48d5-b227-843b8537b23b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/1e4527be-c284-43a8-9aba-abd5cad4153b" status: 202 len: 0 microversion: 2.1 time: 0.164160 Apr 13 22:14:14 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 364/1097] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:14:13 2023] DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/1e4527be-c284-43a8-9aba-abd5cad4153b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:14 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:14 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-d61ecb9a-bb95-46dd-9467-6a5764bf2441 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068796 Apr 13 22:14:14 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 365/1098] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:14:14 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:14:19 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 22:14:19 user devstack@n-api.service[61664]: Thu Apr 13 22:14:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce (ip 10.0.0.210) !!! Apr 13 22:14:19 user devstack@n-api.service[61664]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 22:14:19 user devstack@n-api.service[61664]: Thu Apr 13 22:14:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce (ip 10.0.0.210) !!! Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:14:19 user devstack@n-api.service[61664]: DEBUG nova.policy [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61664) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:14:19 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-1da7677f-7cda-49ab-8da6-7ea557172703 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce" status: 200 len: 1497 microversion: 2.1 time: 0.183555 Apr 13 22:14:19 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 370/1099] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:14:19 2023] GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:04 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:04 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-3b9571fd-9dc3-4b32-9485-dad49bf83c76 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058335 Apr 13 22:15:04 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 365/1100] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:15:04 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aeeba610-93f9-4356-bbb3-37891432f7e6"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:08 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:08 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-fb3b23c9-7a9e-4838-bb74-b496f2340176 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299380 Apr 13 22:15:08 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 366/1101] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:15:08 2023] POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:17 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'services' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:15:17 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-05521d51-b25c-496a-a2cf-cf5c617144d6 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/aeeba610-93f9-4356-bbb3-37891432f7e6" status: 202 len: 0 microversion: 2.1 time: 0.162493 Apr 13 22:15:17 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 371/1102] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:15:17 2023] DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/aeeba610-93f9-4356-bbb3-37891432f7e6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:17 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:17 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-0f4a81b8-a02f-40fa-8c14-d3eaca70662c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049847 Apr 13 22:15:17 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 366/1103] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:15:17 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661382a6-4ad4-4d1a-9bde-63bd9e55d319", "device": "/dev/vdb"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-80dc3879-7f31-465b-a036-616819938f32 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370265 Apr 13 22:15:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 367/1104] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:15:19 2023] POST /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:41 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'services' on Instance uuid 62dee3de-51db-45b8-aa6c-e86fe9bde3ce {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:15:41 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-917090b2-9740-4899-b2ff-933a6ef70660 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/os-volume_attachments/661382a6-4ad4-4d1a-9bde-63bd9e55d319" status: 202 len: 0 microversion: 2.1 time: 0.164583 Apr 13 22:15:41 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 372/1105] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:15:41 2023] DELETE /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce/os-volume_attachments/661382a6-4ad4-4d1a-9bde-63bd9e55d319 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:15:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-a4e7e575-10dc-4a09-b20a-a70454e0afa6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce" status: 204 len: 0 microversion: 2.1 time: 0.134876 Apr 13 22:15:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 367/1106] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:15:41 2023] DELETE /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:42 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:15:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-9a6d9acf-a849-4284-a43a-81d40dd6b7c7 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce" status: 200 len: 1549 microversion: 2.1 time: 0.172288 Apr 13 22:15:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 368/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:15:42 2023] GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:15:43 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "name": "network-vif-unplugged", "status": "completed", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:43 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] Creating event network-vif-unplugged:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:15:43 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-20617dd6-320e-44f2-ab6d-10d1a50274dd req-52e09dd2-5285-4d8f-982c-0e344ccb1321 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035462 Apr 13 22:15:43 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 373/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 13 22:15:45 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "name": "network-vif-plugged", "status": "completed", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}, {"server_uuid": "62dee3de-51db-45b8-aa6c-e86fe9bde3ce", "name": "network-vif-deleted", "tag": "01a4590a-65f3-4dab-a361-264effceb7fd"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:15:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:15:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:15:45 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:15:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Creating event network-vif-plugged:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:15:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] Creating event network-vif-deleted:01a4590a-65f3-4dab-a361-264effceb7fd for instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce on user Apr 13 22:15:45 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-07de5633-3d51-4000-88d8-f1a8887f2f8e req-13fb48d4-c680-4644-a370-0a89cdbf0058 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030526 Apr 13 22:15:45 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 368/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:07 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:07 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8bf8bab5-d977-4bac-8c2e-f7c3d6d3301c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051572 Apr 13 22:16:07 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 369/1110] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:16:07 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4d0f68a-4da9-48ab-a658-605d55674101"}} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:10 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:10 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-90e22013-e6f7-4f32-8d81-4d5dba0e6bef tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288754 Apr 13 22:16:10 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 374/1111] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:16:10 2023] POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:18 user devstack@n-api.service[61663]: DEBUG nova.objects.instance [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'services' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=61663) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:16:18 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-c8faaa3b-dce2-4901-851b-c6d7192b6bc2 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/b4d0f68a-4da9-48ab-a658-605d55674101" status: 202 len: 0 microversion: 2.1 time: 0.212430 Apr 13 22:16:18 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 369/1112] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:16:18 2023] DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/b4d0f68a-4da9-48ab-a658-605d55674101 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:18 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:18 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-967fe690-8c13-4862-b0a5-1d1de7aedd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049914 Apr 13 22:16:18 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 370/1113] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:16:18 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 62dee3de-51db-45b8-aa6c-e86fe9bde3ce] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.wsgi [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] HTTP exception thrown: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Request method failure captured: Apr 13 22:16:32 user devstack@n-api.service[61664]: request: GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce HTTP/1.1 Apr 13 22:16:32 user devstack@n-api.service[61664]: Accept: application/json Apr 13 22:16:32 user devstack@n-api.service[61664]: Accept-Encoding: identity Apr 13 22:16:32 user devstack@n-api.service[61664]: Connection: close Apr 13 22:16:32 user devstack@n-api.service[61664]: Content-Length: 0 Apr 13 22:16:32 user devstack@n-api.service[61664]: Content-Type: application/json Apr 13 22:16:32 user devstack@n-api.service[61664]: Host: 10.0.0.210 Apr 13 22:16:32 user devstack@n-api.service[61664]: Openstack-System-Scope: None Apr 13 22:16:32 user devstack@n-api.service[61664]: User-Agent: python-urllib3/1.26.15 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Auth-Token: gAAAAABkOH6DBYUQr_nD-6UxIlmlkgNY8mXhmi3vLbtWljgjgPyXjF5pDl6gI-2vxQDGKLsRv2dl_SFclfYar__mYQfBTOTNztMxRAZ0FOyMbVaXMzNPWbsBW9mmA3jQQfjev8wNuRP1trJA3ssRWg-2y9rp3U35UICmGfqcD6Ol90nbIWMMB58 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Domain-Id: None Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Domain-Name: None Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Identity-Status: Confirmed Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Is-Admin-Project: True Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Project-Domain-Id: default Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Project-Domain-Name: Default Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Project-Id: ce27f9e91bca45b897b419eac137138c Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Project-Name: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Role: reader,member Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Roles: reader,member Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Tenant: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Tenant-Id: ce27f9e91bca45b897b419eac137138c Apr 13 22:16:32 user devstack@n-api.service[61664]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-User: tempest-VolumesSnapshotTestJSON-793841889-project-member Apr 13 22:16:32 user devstack@n-api.service[61664]: X-User-Domain-Id: default Apr 13 22:16:32 user devstack@n-api.service[61664]: X-User-Domain-Name: Default Apr 13 22:16:32 user devstack@n-api.service[61664]: X-User-Id: cca0b25a70ee4f8e986db91bb9a54662 Apr 13 22:16:32 user devstack@n-api.service[61664]: X-User-Name: tempest-VolumesSnapshotTestJSON-793841889-project-member Apr 13 22:16:32 user devstack@n-api.service[61664]: method: > Apr 13 22:16:32 user devstack@n-api.service[61664]: exception: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. Apr 13 22:16:32 user devstack@n-api.service[61664]: action_args: {'id': '62dee3de-51db-45b8-aa6c-e86fe9bde3ce'} Apr 13 22:16:32 user devstack@n-api.service[61664]: {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. Apr 13 22:16:32 user devstack@n-api.service[61664]: ERROR nova.api.openstack.wsgi Apr 13 22:16:32 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Returning 404 to user: Instance 62dee3de-51db-45b8-aa6c-e86fe9bde3ce could not be found. {{(pid=61664) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:16:32 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a490d3bf-a3c0-451a-8eac-690061c69498 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce" status: 404 len: 111 microversion: 2.1 time: 0.058524 Apr 13 22:16:32 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 375/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:16:32 2023] GET /compute/v2.1/servers/62dee3de-51db-45b8-aa6c-e86fe9bde3ce => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:16:41 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2009437104", "imageRef": "f414347d-1c32-419c-89fc-b23b61a6c286", "flavorRef": "42", "networks": [{"uuid": "1a54a91f-df14-4f72-a7da-7925d7095861"}]}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:16:41 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:41 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:41 user devstack@n-api.service[61663]: DEBUG nova.network.neutron [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] validate_networks() for [('1a54a91f-df14-4f72-a7da-7925d7095861', None, None, None, None, None)] {{(pid=61663) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image limits 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Flavor pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Image pref 0:0:0 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.virt.hardware [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61663) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting quotas for project ce27f9e91bca45b897b419eac137138c. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.quota [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Getting quotas for user cca0b25a70ee4f8e986db91bb9a54662 and project ce27f9e91bca45b897b419eac137138c. Resources: {'instances', 'cores', 'ram'} {{(pid=61663) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Going to run 1 instances... {{(pid=61663) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 13 22:16:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f414347d-1c32-419c-89fc-b23b61a6c286',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61663) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 13 22:16:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-cbf8e4ac-8e33-40c4-8fad-b4da82ab8cfc tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.575374 Apr 13 22:16:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 370/1115] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 13 22:16:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 13 22:16:42 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-907e0299-b1a7-4768-b0cf-fde0e388f8b5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:16:42 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-907e0299-b1a7-4768-b0cf-fde0e388f8b5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:16:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:42 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:42 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-907e0299-b1a7-4768-b0cf-fde0e388f8b5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:16:42 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-907e0299-b1a7-4768-b0cf-fde0e388f8b5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f" status: 200 len: 1213 microversion: 2.1 time: 0.130069 Apr 13 22:16:42 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 371/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:16:42 2023] GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:16:44 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:16:44 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:16:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:44 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] Creating event network-changed:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:16:44 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-5a12c49f-7bb3-4333-ba36-a4213bbb155f req-22e72633-daee-495c-8112-719a9df520b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088722 Apr 13 22:16:44 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 376/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:16:46 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "name": "network-vif-plugged", "status": "completed", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:16:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:46 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] Creating event network-vif-plugged:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:16:46 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-37e68cda-dc57-4d7b-805d-61a8263c2c4e req-b5a32d32-b7f0-4e8e-8a21-bb77c4b88031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042589 Apr 13 22:16:46 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 371/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:16:48 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "name": "network-vif-plugged", "status": "completed", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}]} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:16:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:16:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:16:48 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:16:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.compute.server_external_events [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] Creating event network-vif-plugged:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:16:48 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [req-453e8497-500a-4ff6-a20d-1e2bd25e77ba req-182f79ec-dc48-4ea2-860c-73d071a08cee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060670 Apr 13 22:16:48 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 372/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:16:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:17:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:08 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:09 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:09 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-a2bab3ee-9900-4792-bf66-d3e24544b50d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151045 Apr 13 22:17:09 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 377/1120] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:17:08 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell0:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=4 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b675f687-8d31-45b7-a158-c5c544f9aed0"}} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:11 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:11 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-98ff6f1f-839e-40da-a411-77f25f98b248 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325922 Apr 13 22:17:11 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 372/1121] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:17:11 2023] POST /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell0:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:19 user devstack@n-api.service[61665]: DEBUG nova.objects.instance [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lazy-loading 'services' on Instance uuid 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c {{(pid=61665) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:17:19 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-8bc8f11c-0a6f-4240-8fb2-f6c7a386dc5b tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/b675f687-8d31-45b7-a158-c5c544f9aed0" status: 202 len: 0 microversion: 2.1 time: 0.164971 Apr 13 22:17:19 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 373/1122] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:17:19 2023] DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments/b675f687-8d31-45b7-a158-c5c544f9aed0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:19 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:20 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-dd5ca08d-c8a9-454c-9b0d-2fb893e6a19c tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Apr 13 22:17:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 378/1123] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:17:19 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:17:32 user devstack@n-api.service[61663]: DEBUG nova.policy [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61663) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:17:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-f1d26a22-e376-4b66-bb5b-9cf411e76de4 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f" status: 200 len: 1497 microversion: 2.1 time: 0.216574 Apr 13 22:17:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 373/1124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:17:32 2023] GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:10 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:10 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-6e4a1148-48d7-487f-90ee-be0248ccebbb tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052041 Apr 13 22:18:10 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 374/1125] 10.0.0.210 () {62 vars in 1379 bytes} [Thu Apr 13 22:18:10 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=2 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=6 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:26 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] Creating event network-changed:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:18:26 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-46e018a3-18bc-46e3-93a8-858ed5d0fbe3 req-fb9df6cd-4377-4b12-a2c5-4b7fd1c2fe3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088880 Apr 13 22:18:26 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 379/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=2 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=6 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:29 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:18:29 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-6ed2b1b7-585f-4e1a-9cca-3f63189a92b9 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 204 len: 0 microversion: 2.1 time: 0.200226 Apr 13 22:18:29 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 374/1127] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:18:29 2023] DELETE /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:29 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:30 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94829076c7fa4750a1612b018b83b996', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6949ee0fd24ee7a17424681e101afb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:18:30 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-c0daa2fa-4b5e-45aa-a1e1-10a8cc636c3d tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 200 len: 1573 microversion: 2.1 time: 0.206873 Apr 13 22:18:30 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 375/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:18:29 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 13 22:18:30 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:30 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] Creating event network-vif-unplugged:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:18:30 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-46f4b573-0ad1-47c4-8d75-2592ebaa99d4 req-289a7416-4253-4561-9774-79823168812e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038068 Apr 13 22:18:30 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 380/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:18:32 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "name": "network-vif-plugged", "status": "completed", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}, {"server_uuid": "92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c", "name": "network-vif-deleted", "tag": "bf150898-7f9e-48be-9135-81e2f0b82b27"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:32 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Creating event network-vif-plugged:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:18:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] Creating event network-vif-deleted:bf150898-7f9e-48be-9135-81e2f0b82b27 for instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c on user Apr 13 22:18:32 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-676a18b4-6167-44e7-ae95-8235cbf985ec req-473b8429-4419-47e3-b2a0-dc389276e8a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042500 Apr 13 22:18:32 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 375/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454637d1-a1d8-4e73-9a37-41f76a12907a", "device": "/dev/vdb"}} {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:32 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:33 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-16654fa1-5e74-46e8-a9cc-a95637b8e1b6 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "POST /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414961 Apr 13 22:18:33 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 376/1131] 10.0.0.210 () {64 vars in 1400 bytes} [Thu Apr 13 22:18:32 2023] POST /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f/os-volume_attachments => generated 194 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG nova.compute.api [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61664) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:51 user devstack@n-api.service[61664]: DEBUG nova.objects.instance [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lazy-loading 'services' on Instance uuid 491ef203-bf06-4392-9270-30a02bcd6c9f {{(pid=61664) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 13 22:18:51 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-2cd34e63-e3de-4f3b-96bb-027eb2adf446 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f/os-volume_attachments/454637d1-a1d8-4e73-9a37-41f76a12907a" status: 202 len: 0 microversion: 2.1 time: 0.244080 Apr 13 22:18:51 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 381/1132] 10.0.0.210 () {62 vars in 1493 bytes} [Thu Apr 13 22:18:51 2023] DELETE /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f/os-volume_attachments/454637d1-a1d8-4e73-9a37-41f76a12907a => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:51 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Going to try to terminate instance {{(pid=61663) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 13 22:18:52 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-2784ec25-7df9-4376-82e7-93bbcf5772a5 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f" status: 204 len: 0 microversion: 2.1 time: 0.145774 Apr 13 22:18:52 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 376/1133] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 13 22:18:51 2023] DELETE /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=4 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:52 user devstack@n-api.service[61665]: DEBUG nova.policy [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cca0b25a70ee4f8e986db91bb9a54662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce27f9e91bca45b897b419eac137138c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61665) authorize /opt/stack/nova/nova/policy.py:203}} Apr 13 22:18:52 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-442af580-750b-4339-a338-def7a9587159 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f" status: 200 len: 1549 microversion: 2.1 time: 0.182176 Apr 13 22:18:52 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 377/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:18:52 2023] GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 13 22:18:53 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "name": "network-vif-unplugged", "status": "completed", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}]} {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:53 user devstack@n-api.service[61664]: DEBUG oslo_concurrency.lockutils [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61664) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.compute.server_external_events [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] Creating event network-vif-unplugged:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:18:53 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [req-be294b26-71f6-4153-b794-896159df1aa4 req-12c8a0e8-500d-40cb-9b17-e4fabbfda89c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032935 Apr 13 22:18:53 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 382/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:18:55 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "name": "network-vif-plugged", "status": "completed", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}, {"server_uuid": "491ef203-bf06-4392-9270-30a02bcd6c9f", "name": "network-vif-deleted", "tag": "50746410-9ced-436f-9be1-83b8b4c1d60a"}]} {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 13 22:18:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:18:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:18:55 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:18:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Creating event network-vif-plugged:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:18:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.compute.server_external_events [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] Creating event network-vif-deleted:50746410-9ced-436f-9be1-83b8b4c1d60a for instance 491ef203-bf06-4392-9270-30a02bcd6c9f on user Apr 13 22:18:55 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [req-dcd1269c-007f-4130-9924-6518ac40b323 req-d9954bb0-5008-4c95-8dfc-2e08c53e6fb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030758 Apr 13 22:18:55 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 377/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 13 22:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_api:SELECT=2 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG dbcounter [-] [61665] Writing DB stats nova_cell1:SELECT=6 {{(pid=61665) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '>' {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG nova.compute.api [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] [instance: 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c] Fetching instance by UUID {{(pid=61665) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG oslo_concurrency.lockutils [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61665) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:19:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.wsgi [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] HTTP exception thrown: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Request method failure captured: Apr 13 22:19:20 user devstack@n-api.service[61665]: request: GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c HTTP/1.1 Apr 13 22:19:20 user devstack@n-api.service[61665]: Accept: application/json Apr 13 22:19:20 user devstack@n-api.service[61665]: Accept-Encoding: identity Apr 13 22:19:20 user devstack@n-api.service[61665]: Connection: close Apr 13 22:19:20 user devstack@n-api.service[61665]: Content-Length: 0 Apr 13 22:19:20 user devstack@n-api.service[61665]: Content-Type: application/json Apr 13 22:19:20 user devstack@n-api.service[61665]: Host: 10.0.0.210 Apr 13 22:19:20 user devstack@n-api.service[61665]: Openstack-System-Scope: None Apr 13 22:19:20 user devstack@n-api.service[61665]: User-Agent: python-urllib3/1.26.15 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Auth-Token: gAAAAABkOH4q48zscC8EYyaWsMHIrT9hKGTr109d6fXPNs31_86Ezt_mQM1_4-dLuH1uz2WmnzpdUWkp-N8F_w5J3AkNJ4vUapQEIoGXeotstgUOZrsv3Mj8sbxqx4KXS570wSbOwzK5kXM3UenSEQUm1cBITthWwdarZ6U-oj2Jyh9oZDAJmk4 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Domain-Id: None Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Domain-Name: None Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Identity-Status: Confirmed Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Is-Admin-Project: True Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Project-Domain-Id: default Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Project-Domain-Name: Default Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Project-Id: 6d6949ee0fd24ee7a17424681e101afb Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Project-Name: tempest-SnapshotDataIntegrityTests-2836903 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Role: reader,member Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Roles: reader,member Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6d6949ee0fd24ee7a17424681e101afb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d6949ee0fd24ee7a17424681e101afb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6d6949ee0fd24ee7a17424681e101afb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Tenant: tempest-SnapshotDataIntegrityTests-2836903 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Tenant-Id: 6d6949ee0fd24ee7a17424681e101afb Apr 13 22:19:20 user devstack@n-api.service[61665]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-2836903 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-User: tempest-SnapshotDataIntegrityTests-2836903-project-member Apr 13 22:19:20 user devstack@n-api.service[61665]: X-User-Domain-Id: default Apr 13 22:19:20 user devstack@n-api.service[61665]: X-User-Domain-Name: Default Apr 13 22:19:20 user devstack@n-api.service[61665]: X-User-Id: 94829076c7fa4750a1612b018b83b996 Apr 13 22:19:20 user devstack@n-api.service[61665]: X-User-Name: tempest-SnapshotDataIntegrityTests-2836903-project-member Apr 13 22:19:20 user devstack@n-api.service[61665]: method: > Apr 13 22:19:20 user devstack@n-api.service[61665]: exception: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. Apr 13 22:19:20 user devstack@n-api.service[61665]: action_args: {'id': '92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c'} Apr 13 22:19:20 user devstack@n-api.service[61665]: {{(pid=61665) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. Apr 13 22:19:20 user devstack@n-api.service[61665]: ERROR nova.api.openstack.wsgi Apr 13 22:19:20 user devstack@n-api.service[61665]: DEBUG nova.api.openstack.wsgi [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Returning 404 to user: Instance 92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c could not be found. {{(pid=61665) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:19:20 user devstack@n-api.service[61665]: INFO nova.api.openstack.requestlog [None req-e3473558-bc49-4e78-b257-9a3760d2bd80 tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c" status: 404 len: 111 microversion: 2.1 time: 0.052706 Apr 13 22:19:20 user devstack@n-api.service[61665]: [pid: 61665|app: 0|req: 378/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:19:20 2023] GET /compute/v2.1/servers/92a1eb1f-c2b6-4d63-bd4c-4056b8eb5f2c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 13 22:19:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_api:SELECT=4 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:20 user devstack@n-api.service[61664]: DEBUG dbcounter [-] [61664] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61664) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:20 user devstack@n-api.service[61664]: DEBUG nova.api.openstack.wsgi [None req-ddcb8d1f-265f-4bad-a824-9463867166dd tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] Calling method '.version_select at 0x7f4b3c8e9360>' {{(pid=61664) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:19:20 user devstack@n-api.service[61664]: INFO nova.api.openstack.requestlog [None req-ddcb8d1f-265f-4bad-a824-9463867166dd tempest-SnapshotDataIntegrityTests-2836903 tempest-SnapshotDataIntegrityTests-2836903-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-309329044" status: 202 len: 0 microversion: 2.1 time: 0.038846 Apr 13 22:19:20 user devstack@n-api.service[61664]: [pid: 61664|app: 0|req: 383/1138] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 13 22:19:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-309329044 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG dbcounter [-] [61663] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61663) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 13 22:19:42 user devstack@n-api.service[61663]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 13 22:19:42 user devstack@n-api.service[61663]: Thu Apr 13 22:19:42 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f (ip 10.0.0.210) !!! Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Calling method '>' {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG nova.compute.api [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] [instance: 491ef203-bf06-4392-9270-30a02bcd6c9f] Fetching instance by UUID {{(pid=61663) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Acquiring lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG oslo_concurrency.lockutils [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Lock "02a5ac41-3f13-423f-89bb-da05d1dcefff" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61663) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 13 22:19:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.wsgi [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] HTTP exception thrown: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Request method failure captured: Apr 13 22:19:42 user devstack@n-api.service[61663]: request: GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f HTTP/1.1 Apr 13 22:19:42 user devstack@n-api.service[61663]: Accept: application/json Apr 13 22:19:42 user devstack@n-api.service[61663]: Accept-Encoding: identity Apr 13 22:19:42 user devstack@n-api.service[61663]: Connection: close Apr 13 22:19:42 user devstack@n-api.service[61663]: Content-Length: 0 Apr 13 22:19:42 user devstack@n-api.service[61663]: Content-Type: application/json Apr 13 22:19:42 user devstack@n-api.service[61663]: Host: 10.0.0.210 Apr 13 22:19:42 user devstack@n-api.service[61663]: Openstack-System-Scope: None Apr 13 22:19:42 user devstack@n-api.service[61663]: User-Agent: python-urllib3/1.26.15 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Auth-Token: gAAAAABkOH6DBYUQr_nD-6UxIlmlkgNY8mXhmi3vLbtWljgjgPyXjF5pDl6gI-2vxQDGKLsRv2dl_SFclfYar__mYQfBTOTNztMxRAZ0FOyMbVaXMzNPWbsBW9mmA3jQQfjev8wNuRP1trJA3ssRWg-2y9rp3U35UICmGfqcD6Ol90nbIWMMB58 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Domain-Id: None Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Domain-Name: None Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Identity-Status: Confirmed Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Is-Admin-Project: True Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Project-Domain-Id: default Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Project-Domain-Name: Default Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Project-Id: ce27f9e91bca45b897b419eac137138c Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Project-Name: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Role: reader,member Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Roles: reader,member Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce27f9e91bca45b897b419eac137138c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}] Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Tenant: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Tenant-Id: ce27f9e91bca45b897b419eac137138c Apr 13 22:19:42 user devstack@n-api.service[61663]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-793841889 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-User: tempest-VolumesSnapshotTestJSON-793841889-project-member Apr 13 22:19:42 user devstack@n-api.service[61663]: X-User-Domain-Id: default Apr 13 22:19:42 user devstack@n-api.service[61663]: X-User-Domain-Name: Default Apr 13 22:19:42 user devstack@n-api.service[61663]: X-User-Id: cca0b25a70ee4f8e986db91bb9a54662 Apr 13 22:19:42 user devstack@n-api.service[61663]: X-User-Name: tempest-VolumesSnapshotTestJSON-793841889-project-member Apr 13 22:19:42 user devstack@n-api.service[61663]: method: > Apr 13 22:19:42 user devstack@n-api.service[61663]: exception: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. Apr 13 22:19:42 user devstack@n-api.service[61663]: action_args: {'id': '491ef203-bf06-4392-9270-30a02bcd6c9f'} Apr 13 22:19:42 user devstack@n-api.service[61663]: {{(pid=61663) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. Apr 13 22:19:42 user devstack@n-api.service[61663]: ERROR nova.api.openstack.wsgi Apr 13 22:19:42 user devstack@n-api.service[61663]: DEBUG nova.api.openstack.wsgi [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] Returning 404 to user: Instance 491ef203-bf06-4392-9270-30a02bcd6c9f could not be found. {{(pid=61663) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 13 22:19:42 user devstack@n-api.service[61663]: INFO nova.api.openstack.requestlog [None req-4d546217-91bd-4e6c-951b-bc10f559be37 tempest-VolumesSnapshotTestJSON-793841889 tempest-VolumesSnapshotTestJSON-793841889-project-member] 10.0.0.210 "GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f" status: 404 len: 111 microversion: 2.1 time: 0.051217 Apr 13 22:19:42 user devstack@n-api.service[61663]: [pid: 61663|app: 0|req: 378/1139] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 13 22:19:42 2023] GET /compute/v2.1/servers/491ef203-bf06-4392-9270-30a02bcd6c9f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)